What shutter speeds are you typically using?
You say when you use a tripod all is OK but sometimes have trouble holding the camera still and occasionally use 1/4 second.