I wear glasses and use that eyepiece extender without the optics. I tried it first with the optics and hated the view but liked the space for my big nose, so I pulled the optics out and now love it compared to having the viewfinder right on the body. I use a Minolta right angle finder for most of my SLR work now, but if I need to go light/small, I'll use the EX15.

I don't know that it solves the OP's problem, though.