Hey there,
Wow! Do I understand where you're coming from. I have only been doing this for about 5 months now but up until last week I was doing it all on a Mountain Bike (who by the way looks exactly like your bike except of course that she's a mountain bike). Anyway, I always ride along because my partner doesn't ride. I am naturally cautious about where I ride and how I ride, but on the new bike it's almost like learning all over again. I can't imagine trying to keep up with others right now until I get comfy. Patience, patience, patience....number one rule. At least for me. You'll get it and probably blow him away a time or two. Good luck and don't quit, you're doing great!
Gray