I think have a low-level latex allergy: they're irritating to me if I wear them for more than a few minutes, so I can relate. I use nitrile or vinyl gloves instead, with no problems at all. Wearing gloves is cheap insurance that I'll be able to continue my photographic pursuits for a lifetime.