I always use a filter , as I am always split printing and the difference of the white light and that of a filter in place is quite significant.

It is ok to go without a filter by all means, if you are getting great results without the filter this means you are pretty consistent with your negatives
and that is a good thing.