IMO, the recipie for getting good people shots is; actively looking for/hunting for/creating the right situation, moving quickly to the right vantage point, and then timing the shots.

My thought is that if you are putting your camera in something that's going to slow down that process, you may as well put it away and just enjoy the conversation until you are ready to pay attention to shooting again.