Never been to Hearst Castle! It is about 4 hours from the east bay, and 4 hours from the edge of Los Angeles. I've only driven there once, and it took 9 hours... I was in my 1931 Woody Station Wagon, so the going was slow! I just picked San Simeon because it is a pretty coastal town with a lot of fun stuff to do.