Less than 10% of Lyme disease patients develop heart problems. Symptoms include irregular heartbeat, dizziness and shortness of breath. These symptoms usually show up a few weeks after infection and only last a few days or weeks.