I think Steves' advice is spot on. There is a lot of variables in this setup, making it difficult to source what's wrong.

Try do a few shots on a tripod at least, as you've said that you often move the camera when you press the trigger (I know I do too). Use bigger apertures than f22, because at that point you are going to be close to the diffraction limits. At a shallower depth of field you'll see more clearly if it is out of focus, too.