It will get better with time, I promise! My first bike was really stable, but I still felt like I could crash at any second if I so much as moved my hands a tiny bit. Now my bike is a relatively twitchy, racey bike, but I'm forever pointing at things and moving my hands all over...hoods, drops, tops...feels perfectly stable. It just takes time. Eventually your bike will feel like an extension of you.

For now ride where you feel most comfortable. You can always get back in the middle once you are familiar with your bike and its handling.