In my experience, men who are very offended at being passed by a woman are actually quite rare. They tend to stick out in your mind, but most guys are relieved if you can keep up, as they don't have to keep stopping to wait for you. The rare obnoxious ones tend not to join clubs, because in a club they'd find a lot of people they can't bear to be passed by - older riders, kids, etc..