My suggestion is to stop "fighting the ground glass," stop thinking about the image being upside down and reversed every time you look at it. Be one with the ground glass; accept what is there.
But perhaps some people can't adjust to seeing this way? I often find myself reviewing a shooting session in my mind and realize that I never really thought about the image being inverted/reversed. I assume that other LF shooters experience the same thing?