Sounds like you are comparing yourself to everyone else, all of whom are faster in your eyes.

How about not thinking about them and just go on exploratory rides. You can learn your new area that way without having to go on a club ride. You could also find out if there are others your speed--I bet there are and they are intimidated by the fast club rides.

Running errands and commuting by bike are great ways to get where you need to go and learn the lay of the land in your new place.