I hear this a lot. a newby goes on a "beginner" ride and the guys make it into a race. That is REALLY not very nice. I hope you said something to them!!!
keep looking you will find better people to ride with.
and welcome to TE!