It could actually be that you need to eat more after your ride. I often find that if I've been a bit cold for quite a while that I warm up at last after a meal. It is the burning of calories that creates body heat in the first place, after all.