As many others have said, I use both. I will carry my Voigtlander RF with me most of the time - it is small enough to do so without much hassle. For specific projects I am likely to use one of my SLRs - Canon or Olympus OM.
As Fotch said, a camera is a tool. You wouldn't restrict yourself to either a screwdriver or a hammer, would you?