It's not likely it will affect the image it will produce. But... you are already indicating you are dissatisfied and that's the general tone of your question.
If this is the case, regardless of it will have any material effects or not, you will see that scratches every time and it will bother you as long as you own that lens. I'm the same way. I'd return it.