The only time I have ever been confronted was when a group of (somewhat ragged) street performers demanded I pay them $1 after I took a candid of them. I think they were joking...