In my opinion, B&W is about shape and contrast, colour is about well - harmony in colour. B&W is the percussion section and colour is the strings. To the human eye, vibrant colours- especially red (blood or ripe fruit for a hunting primate) will completely dominate a scene. When you switch from shooting in B&W to colour you need to concentrate on how a single splash of bright colour will distract from shape and tone while going in the other direction you need to learn to ignore the distracting bright red, if it is going to be just an insignificant middle grey in your print.
It's possible to learn to go to and fro but maybe the best work comes from sticking firmly to one or the other to avoid artistic confusion.