Jeannierides, maybe what you need is to practice riding without the BF. I'm sure he's a great guy, but even the most well-intentioned people can expect you to do it their way and get frustrated with you if you don't. If you can find a women's only group to ride with or, as Duck On Wheels suggested, get out there yourself someplace where there's less traffic, you could develop the confidence and skills necessary to not worry about what he thinks you should be doing. In riding, the most important relationship is between you and your bike, not you and your riding partner (even if it is a BF/SO/whatever).

Any bad ride should be a learning experience, not a confidence-breaker.