If the AI conversion was aftermarket, or if you are using a poorly designed adapter, it is possible the lens is not parallel to the film/sensor plane.
Alternatively, it may also be that the lens is not assembled correctly and it is not as sharp as it appears in the virefinder. it is very hard to judge sharpness in the viewfinder.