Maybe ride once a week with the men (challenging ride), once a week with women who don't really care for speed (recovery & chatting) and the rest on your own, following some kind of program?