Only wildlife that ever scared me was a skunk that got me trapped on a pier at night. I was out about half way, with no place to go when I saw him approach. He walked onto the pier and to within 12 feet of me and I was just starting to panic at the thought of a long smelly ride home when he suddenly lost interest and turned back.
As far as humans go, the only ones that scare me when I'm shooting at night are the cops and security guards. They're usually bored stiff and just itching to find someone to hassle.