I always do this. In fact it's been so successful that I now only own one lens for each system (16mm + Nikon, 35mm + Leica).

I hate carrying gear.