If you worry about battery leakage, put in a fresh battery once a year, and you'll be fine.
I wouldn't worry, though. Just take the battery out when you store the camera for any longer period of non-use.

But yes, you can remove the battery and use it as a mechanical machine. Just put the camera's shutter speed ring to "C".