I wear a small and have extra pads placed in the necessary places. For me this worked.

If it makes you feel any better when we did a story about one of the rides around here we made the news reporter wear my road helmet (I was wearing my mountain bike helmet)-and it FIT!!
Now, this guy was like 6'4!

We are NOT alone!