Setting the ISO dial on the camera adjusts the camera's meter - which you are ignoring anyway when you use a handheld meter and manual camera settings.

So changing the ISO dial but not using an "Auto" exposure mode, doesn't link camera meter to f/stop or shutter speed so it would have no effect.

(same thing E. von Hoegh just said)