I have to echo the cross bike recommendation. Lots of the best things about hybrids (wider tires, some can take fenders for wet weather, definitely able to handle gravel/dirt roads), but with drop bars (which I, like you, prefer). I also expect that since you are used to riding a nice road bike, you might be more comfortable on one. I am also definitely more comfortable over longer distances on one.

Salsa Vaya is a good recommendation, as are some of the bikes by Kona (the Jake line, but I don't know if they have fender mounts), Trek Crockett, Surly Straggler (I own this one) - lots of good ones out there!