I do not have the impression you moved. It seems to me that more link to size of the hole of its shape. Aloso it is a 135 film. This is clear with pinhole very rapidly when you enlarge such format you got blur photo.
But this is pinhole and hand made pinhole, so, do not expect to have sharp pictures.
An example of what I do with matcbox pinhole, your photo are very sharp compare to this one
An other example with a Populist