Don't underestimate the importance of fit.

If your bike was originally set up on the assumption that you'd never be using the drops, it may not fit you all that well in that posture. It may be worth a new fitting.

I have one stem that makes riding comfortable for me on the hoods, and a different one that makes riding comfortable for me in the drops. Either stem is okay in the opposite posture, but each is notably better in one. I'm not sure if that's normal, or if it means there's something else going on that can be fixed ... or that my frame doesn't fit me as well as it ought ...