I bought a set of cheap step-up and step-down rings and too many times, there were vignettes on my pictures. The size of my rings average down between 3 & 5 mm. I don't know what to think of that but I use less and less those rings.
One thing for sure, what matters the most is the ring size or tightening as DWThomas said. tightening is the rule, so far.