Usually people seem to don't mind when I take their shot.
But some people sometimes looks annoyed but they never say anything.
I never had any problem.