I've heard that "drilling" with the needle is better than poking straight through, kind of what 2F/2F mentioned. You didn't say which method you used though. I'd also advise trying your pinhole out on a camera if possible before you spend hours fretting about the perfection of the hole - it could be fine how it is despite the edges.