I agree and fear that it is getting harder and will get harder to photograph whatever we feel like, as in the past. I am of the opinion that we need to be a little stoic and mix some common-sense into what we are doing. With the ever growing terrorist threats we face today, taking photographs of things like trains, airports, and some public buildings may become more difficult. Of course, photographing children not your own seems to be a definite no-no these days. I have photographed all over the world and must say that North America is still the place with the least rules. You should not have any problem while in Toronto, in spite of some of the bad press it is a very photo friendly place. Generally you should have no worries in public places. On private property I would ask permission. Have a great trip.