I only had a M645 for a short time but doesn't it have 2 shutter release buttons. One on the front by the lens and one on top by the viewfinder. Try the other one and see if it's smoother.

Sounds like a CLA is in order.