The folding Voitlanders are smaller than the Retinas and they fit easily in a pocket. They would be fine for print film where you don't need a meter. But I find an external meter too fiddly for 35mm, so they are not a first choice for slides.
The 35RC is a great camera, either on Auto or Manual. But with the lens and all, it would be a challenge to pocket. But I am really puzzled why you don't think the XA can be used in manual. With the built in meter, aperture and ASA settings, it is very easy to use any manual setting you could want.
I was hoping to go to a higher image quality. My XA does a good job, but not up to Rollie 35 or Minox lens quality. At least in my experience.