Battery should be good. It was working fine in the FE. Only a month or so old. That being said, I've had issues with other batteries from the same batch. The camera is new to me as of yesterday, and I have not had an FM before, but from looking through the manual, I don't think I've missed anything.
Forgot to mention, when I said it got better, I think I was able to set it to ISO 400, and a shutter speed of 1/15 or so at f/1.8 and it would show as over/correct exposure when looking at the ceiling lights. Certainly better than 3200 and 1 full second. I'll try exercising the coupling as well, thanks for the tip. I also still need to use my DSLR to get an idea of the correct exposure so I have an idea when I'm getting close. But that'll have to wait till after work.
Thanks for the input!