I wouldn't use a polarizer, unless I really want/need it. It will needlesly effect your image (as described above).

For your purposes I would get a ND filter and/or shoot Tri-X at ISO 50 or 100.

If you're willing to use an other film as well, try Ilford FP4+ at ISO 60 or 150.