So, when you look at the thermometer and it's just too cold to bike....it may not be too cold at all to do a brisk walk or jog and be able to keep perfectly comfy.
Brrrr, self-made wind chill.

I found it helps to head for the woods on my mtb on really cold days. It seems to be warmer there.