Just from the sound of it, you're probably in the clear.
My camera has the usual wear from being handled. A small ding in the finish, here and there. Everything is in working order.
If your camera is in similar condition, you've probably got nothing to worry about.
If you are keeping it as a shooter, more's the better. If the camera was in pristine, collectible condition you'd always be worried about messing it up.
As a photographer, not a collector, I'm more concerned about the photos the camera takes than the looks of the camera, itself.
Hope you get some great shots with your Rollei!