You are right. I have been Talked Too by the locals about what Breaking and Entering is when I wander into a building. Something I do not do very often.
Earlier in the thread there was mention about trying to show areas like Detroit in a more favorable light. That really does sound like a bigger challenge.