I read the question to be one of a philosophical nature. In the grand scheme of things, on a philosophical level, what does it matter? The land is every much yours to photograph as it is their's to worship. I'm not talking about a holy place built by the hands of man, I'm talking a place built by a power greater than us all. Who is anyone to claim spiritual ownership? Now, should someone intentionally offend someone for no good reason? Of course not. The photo wouldn't carry the same emotion you intended to capture... if your intentions were good to start with.