This happens quite a bit to me and it's usually not a problem because I haven't run into too many weirdos. I think strange people will sit on your wheel because they are tired and they simply want a pull. Or sometimes, they just want chat with other cyclists. And sometimes people are just plain creepy and are trying to pester you. It's a good thing you had your hubby along.

If it were my situation and I didn't want some weird stranger on my wheel, I'd just slow down and tell him to go around ...and I'd say it with such a tone that I didn't come off like a b!tch, but that I made it clear that I don't want to chat and that the only option is to go around me. And I also might be ready to grab my pepper spray if I thought it was warrented.

Also, I think that many men don't understand about personal space....whether it is drafting off your wheel or walking too close to you on the sidewalk etc.