Becca,

I've gone so far as to wear long johns (both silk ones and more high tech ones) over shorts and under biking tights.

You're sure the hives aren't more a heat rash?