The idea of not being in the drops on the sort of downhill that requires lots of braking scares me! Getting your weight back a bit further will definitely help with balance and control on the downhills, and you can always practice getting in and out of the drops on some flat, traffic-free spot until you're comfortable enough to give it a go on the hill.