Downrating the film affects exposure, not sensitivity ("speed").

Downrating without a filter only overexposes the film. It does not change the ratio of visible-to-IR light that is making the exposure.

Changing that ratio is what makes the film look more or less "IR-like." You change that ratio by selecting a filter.