I have the same issue with a few viewfinders, so I use a bit of gaffer's tape to secure them. It's simple and doesn't look too bad. As long as you don't leave it on too long, it wont leave residue. The other thing I've tried is a piece of very thin polyester tape stuck to the bottom of the finder foot to make the fit more snug.