It's not just about whether or not you're cold-blooded or warm-blooded. When you're exercising, you create heat and don't need as much. Even when my friend and I were only walking in the mornings, on sub-freezing mornings we'd start off bundled but have to strip off layers after we'd gotten a half mile or so.