Many of the cameras mentioned do take great photos but some are getting expensive. I keep an eye open for them but they just don't find their way into the Thrift Stores I shop in. I manage to find this Konica A4 on the bay for $17. After running a film through it I can recommend it. It is sleek and small enough to put in your shirt pocket.
Konica A4 P&S by dbuckle2695, on Flickr
Open by dbuckle2695, on Flickr