Welcome to APUG.
The LR44 is an alkaline battery. The Nikon FE was designed for two 1.5V silver oxide cells, or one 3V lithium cell. The silver oxide or lithium cells are much more likely to supply the correct voltage under load to the camera.
You need to try the correct battery(s) to see if that will solve your problem.