Even at that us small people are always at a disadvantage in the wind. No matter how aerodynamic we make ourselves, frontal area doesn't go down in proportion to height or weight.... So smaller people, who put out less power (we generally need less, as we are moving less weight), still have to push through nearly the same amount of wind resistance as larger, more powerful people. It's the same reason you generally do not see the little climbers winning TT's at The Tour.