I am a color photographer, and I find statements of this nature purely subjective, each photographer is going to find their own set of difficulties in each medium, I find B&W far more difficult due to the fact I have to change my thinking process to see in tones and not colors, I have never been a good one for converting colors to tones, so my difficulty is the seeing portion of the process.