Street photography is like jazz -- every definition is either too restrictive or too all-inclusive. What isn't street is the easier question.
Best to start by investigating those who defined the genre; Cartier-Bresson and Winogrand, for instance.
Street photography starts in the street but it doesn't have to end up there. Typically it's candid, not set up.