A simple thing to check is to see if the elements of both lenses are screwed in tightly. I had a similar issue on one of my tlrs and came to find that the taking lens, which I removed the front element to clean out some dust, was a few turns away from tight. Tightened it up and all was well. If this is the case and its happening at infinity, would be the taking lens. Good luck.