Even with regular club rides, there seems to be no 'middle' group. Regulars are too fast and beginners are too slow for me. I do have a few friends here who ride like me and those rides feel great. I am just not that crazy about riding alone. And if I was to ride every day, I would have to ride alone.
Didn't mean to offend featuretile that you didn't ride often per week.

Great that you have some friends to ride often. Sounds like having supportive person in sight is motivating for you.

I'm not sure what to recommend since you don't want to ride alone.

Part of being slower than a faster pack is learning to be comfortable with oneself on the bike either solo or at least with your DH or friend around if you are unfamiliar with the route.

My dearie has been away in the U.S. for nearly a month now. All the riding I've done daily....has been solo.

But I'll be joining him just north of Seattle this weekend and we'll ride home together to Vancouver.