Also, don't be afraid to move the bike around under your body. If you feel like you want to rock the bike back and fourth with your hands as you pedal, then go with it.
I know when I first got started, I somehow figured that it would be better for the bike to stay perfectly vertical when I was standing. I feel much more comfortable now that I'm used to "working" my bike.