glbeas has suggested some interesting things for Ga. If you come in to Altanta the architecture is not really exciting. Too new and modern for my taste, however, if you like a lot of glass buildings it might be just the ticket.
Depending on the direction coming from , between Columbus Ga and Atlanta there are several small towns that have some interesting old buildings. Eufala has some very old homes down main street, but lots of trees and funky lighting.