I'm afraid I think you over-reacted.
IMHO, every "found" shot in public places is fair game.
And unless the interaction between the other people and you prevented you from doing what you were trying to do, it wasn't worth getting excited about it.
Although I'll allow you a certain level of grumpiness when shooting at sunrise (I'm definitely not a morning person).
If the others unreasonably got in the way or were disruptively noisy or rude, or were trying to copy something that you have set up (like a studio shot) I would agree with your response.