I've done it most of my life. In fact, I recently got back from two weeks in the backcountry with large format gear, much of it off trail at high altitude with plenty of tempermental weather. What's
the point of even owning a camera if you don't have some bruises and blisters to show for it? But seriously, just find someone already into this kind of game and have them coach you about how to
navigate the outdoors safely and with appropriate gear. Who wants to hang out in some stinky gym
like a rat on a treadmill when they can be outdoors shooting? It will keep you in shape.