I am not sure if your enlarger is a condensor or diffusion light source enlarger. However this sounds like my Durst when the lamp is not properly adjusted to the condensors.

If you have a diffusion source, then I would plan on everything internal to the light path needing to be a flat black.