Layers! Make a note of which layers you need at which temps, and peel off accordingly for the ride home. I can be wearing 3 or 4 layers when it's really cold, which means it takes ages to get dressed but I can always adjust to the temps. Getting too hot and sweaty can get you colder in the long run than being dressed jsut right.