I've never gotten permission. Never needed to.

I live near a National Cemetary and was told I am allowed to photograph there with the stipulation that I cannot single out a grave marker.

No problem.