If you have the time to spend, I would recommend the day trip out to the Dry Tortugas and Fort Jefferson. My favorite pictures from my trip to Key West were taken there. Other than that, I enjoyed the inner part of the island where the "natives" live over than the Duval madness.