To PeterB - I wasn't addressing your problem,but the Original posters.His image didn't look properly sharp when correctly focused. Are you seriously suggesting that a magnifying lens can be used for critical focusing even when not focused on the ground glass?
That is equivalent to dialling out a viewfinder dioptre adjustment, or using a focusing loupe set wrongly.
You can do it,but WHY?