I (hopefully) ordered everything I need today:

Arduino Duo $20
4x4 keypad (tough to find one with letters!) $15
16x2 red LCD $8
Power switch tail 2 $30
Breadboard jumper wires $5

I found everything (except the Power switch tail 2) on ebay. It's all being shipped from China, so I figure I'll have everything in about 10 days. I should be able to scrounge some sort of case, so les than $80 shipped for everything isn't too bad.