Luckily I don't have to do it very often.

My saving grace is that I print on matte or textured paper, which means spotting is infinitely easier. Compressed air in the darkroom is the best thing I've ever found to get dust off the negative before I load it in the enlarger. Some say always use glass negative carrier, but I just don't, and don't care about the slight inferiority of focus, and it saves me a TON of time in spotting.

I've also learned to store my negatives such that dust doesn't have a chance to get to them until I bring them out to print. They are in PrintFile sleeves in an archival 3-ring binder within an archival box that seals out air flow. This has made a huge difference to me, and I really hate digging out old favorite negatives to print, because they are usually dustier from not having been stored well at the beginning of their lives.

Finally - diffuse light source helps a lot.