So if I was to visit the US on holiday (vacation) and photographed the Whitehouse (or any other 'tourist-interesting' building) I would/could be arrested?

It puzzles me how little you can photograph in the US these days, I also seem to remember a thread, not long ago, about people not being permitted to photograph Monument Valley due to something to do with Native American rights, is this true?