If you think photography trips are a pain try fishing. I also flyfish and with two little boys "fishing too" I never get a line wet.
My oldest used to go on photo trips with when he was a toddler. Except for the diaper changes and learning it was alright to pee in the weeds we had a lot of fun. The youngest did not have that opportunity. We had to move and I was working two jobs. No time for photography trips.
By the way, that pee in the weeds thing can back fire when they drop trou in the landscaped restaurant parking lot.