I see the "other viewpoints" expressed, but I SO would have gone off on him after the ride! Just because he's the group leader for that ride doesn't give him the right to berate you in front of others!
This is a club ride correct??
I've seen many times where one (usually rather obnoxious) person appoints themselves as leaders, and makes everyone else fall in line.
I can't believe that the others are putting up with it??!!
Sheesh. The guy needs to be put in his place.
If he had a problem with your pace then he should have ridden up alongside you and asked that you not leap frog. - In a NICE CALM TONE....