It's more about your power to weight ratio. You can be very powerful, but very large, so not too fast.
For example - it would take approx 217 watts for my husband to keep up 21mph on a flat with no wind, but for me it would only take about 158 watts.