I second this! If I'm wearing a wind breaker, I can wear fewer or less bulky layers. The wind makes a huge difference for me.
Subfreezing temps (I have yet to ride at less than 25 degrees) I wear knee high ski or snowboard socks over thin "liners" to help with wicking, tights, knickers, longsleeved wool undershirt with a collar to keep the wind from coming down my shirt, jersey and a windbreaker, ear warmer under my helmet, and gloves with a windbreaker outside and fleece inside. Generally, I'm always cold (Reynaud's Syndrome) but I sweat, too, so I'm very conscious about how I feel on any particular day, and not overdress so I keep the sweat to a minimum. Keeping the wind off has definately been the key for me.
Anything above freezing, I may just do tights or legwarmers with regular socks/shorts, longsleeved undershirt or shortsleeved w/arm warmers and a jersey.
More importantly for me is that I HAVE to me warm when I start. That may mean sitting in my car with the seat warmer and heater on, shoes off to warm my feet, putting my gloves and shoes up to the vents to heat the insides of them, getting dressed inside the car before I even open the door. If I'm cold to start I never warm up, but if I'm warm and dressed properly (all skin covered to the cold, but not necessarily bulky) when I start I'm fine. Im just not stopping for any breaks!!