Are your negatives "flat" and do you filter under the enlarger to increase the contrast on paper? I noticed thet filtering to get higher contrast (grade 3-4) increases the grain visibility even with moderate speed film to the point it is somewhat intrusive on textureless areas.