If you see grain that far out, you will be fine.

Keep in mind that you actually increase the depth of field on the paper the further you stop down.

And of course... if you stop down to far you start to lose sharpness from diffraction.

But I would say you are now at the point where it will behoove you worry more about making a beautiful print as opposed to one which is in focus.