If you don't need GG viewing, how about just holding the film holder in place with two big rubber bands?

If you do need a GG, you could build a simple frame that holds a GG at the same plane as the film holder (you might even be able to scavange a bad film holder to make this), and use the rubber band trick to hold that in place before swapping in the film holder.