First of all there are some strong older women with weight on their bones that can blow away alot of people; weight, size, age means nothing in cycling. Experience is the key.
I do alot of Club riding and I always tell newbies to hang in the back and attempt to find your own pace. Trying to ride someone else's pace in order to stay with the pack will blow up your legs. Just do your best each week to hang with the rear of the pack and with experience, you will find yourself inching up towards the front. Alittle patience is needed.
Don't give up - there are alot of benefits with group riding. It brings out the compeitive spirit in me and makes me want to ride harder. I've also learned so much from folks I ride with. But I didn't start out front. I hung back, rode by myself alot until I built the skill, speed and endurance to stay with group. Just give yourself some time.