You just have to rethink the way you approach photography. After those 23+ years if I've learned anything it's that you can't wait around for a good weather day to do it. You just need to adapt.
For instance, I've developed the art of street-style photography, or something resembling that anyway, but done from the driver's side window of my small truck. The camera bag and lenses are on the passenger seat. The heater is on. The equipment doesn't get trashed. I don't catch pneumonia and die. All in all, a good deal. You'd be surprised the interesting subject matter one can find. Just stay away from playgrounds and government buildings.
If during your three days it's non-stop raining, maybe you could rent a car and do something similar?