I have a Fuji GA645 and do this sometimes. Not as much as when I first got it though. I bought a hood for it and now only use the lens cap when storing it. When I take it out to bring somewhere the cap comes off and stays home. If I'm worried about exposing the lens to the elements I keep the camera in a bag for protection but when taken out to shoot no lens cap at all, ever.