Is it a collector or a shooter?

If it's a shooter, leave it alone. Cosmetics don't affect the picture.

If it's a collector, restore it but consider sending it in for a complete restoration instead of spotting here and there.
A spotty job will look crummy and will likely detract from the collector's value. Sending it to an expert will add to its provenance and, with luck, might enhance the collector's value.

My Rollei is a shooter. As long as it looks "decent" it doesn't matter to me.

As far as I am concerned, function trumps cosmetics almost any day.