I purchased a little Olympus XA from a local thrift store for $15.00. I didn't really know what to expect but I have been very surprised at the reliability and quality of the images.
It is battery dependent so get a spare.