That is not a good safelight test as it does not account for the additive exposure of safelight plus print exposure. Do a proper safelight tests by following instructions from Kodak or Ilford.
Also check for other sources of fogging: light leaks from enlarger etc. These are sometimes less obvious unless you first turn off all lights, let your eyes adjust to the dark and then turn on the enlarger.
If there is low contrast without fogging check the temperature of your developer, development times.