I hear you, ultimately it is a matter of personal preference. I understand that. I have a problem shooting in the spots you mentioned downtown Toronto; isn't that funny
Of the places I mentioned, the Junction is probably the mellowest with less attitude, fewer scary people, and some decent places to eat and drink. If not, then there's always the Distillery. What suits you in the GTA?