I'm a road newbie too and have the exact same problem, except my fear is more related to when I'm riding in traffic and stopping at traffic lights & stop signs. I'm afraid to stop and my body shakes, which effects my balance when its time to start again. Watching youtube videos to get the right technique down has helped; but it's a fear that I'm still working on overcoming.