It may be something embedded in the little dimples. If so, then I'd first scrub it clean with Bon Ami or Soft-Scrub.

If it is little burrs raised when they made the little dimples - a manufacturing defect - then emery cloth or 1200 wet/dry sandpaper should do the trick.

Can you feel anything if you drag your fingernail across it?