There are quite a few small towns in Ga. that still have old buildings still standing. Around Savannah theres a very large number of old architecture going all the way beck to one pre civil war fort I've been to.
The barrier islands all down the Atlantic and Gulf coasts have very interesting flavors to them.
Also consider Charleston, another vintage city. Haven't been there yet but I've heard good things about it.
Get in touch with me when you get into the Georgia area, I might be able to find some contacts for you.