Do it! I rarely like carrying more than one body and one lens. Work with what you have and don't worry about the lenses left behind. Primes are great because they give the old "leather zoom" a workout. I think it forces better composition. I'll convert color to b&w when the mood strikes or when the color photo is somewhat boring.