The arthritis may shift from one joint to another. But the knee is most commonly affected. About 10 to 20% of untreated Lyme disease patients develop chronic arthritis, which lasts a lifetime.