Depends on what you mean by "harder". Harder to produce a really "Fine" photograph? IMO, NO. It is equally difficult ... and probably, obtaining the essence of that which makes it "fine" is equally difficult among ALL media.
I've worked with charcoals, pencils ... many more. To me, obtaining "a good one" is easiest in photography, but I really think that is solely because I am most familiar with photography.
To "bang out" an image -- somewhat resembling the subject (Picture Phone type) -- with little regard for quality ... by all means - use a Picture Phone.