The match needle system in my FE2 can and does sometimes work like you mention, fact of life with these as they get older. That said, I would put a new set of batteries in. New batteries in my FE2 makes it young again and is my solution for whenever it starts to act up.

Sometimes the mirror seems to stay up a fraction longer, new batteries, works perfectly again.

It might not be the batteries, but my experience and a few others who had them new in the eighties as I did, did seem to find new batteries cured a multitude of ailments.