The area around Julian and Santa Ysabel isn't properly "desert", but it's lovely country, and while Julian itself is a bit self-consciously restored ("Look at me! I'm an Old West town!"), the general area is well worth exploring. Santa Ysabel is my personal favorite of the California missions.
Drop me a PM if you want to go out shooting sometime.