I'm reading that the typical daytime winter temps for Atlanta are in the mid 40's to mid 50'sF range- so we are not exactly talking Antarctica here.
Still, an early morning ride starting out at 35 or 40F would be worth wearing some warm tights for, and a thin merino base layer. Hands and feet tend to get colder than anything else, so don't skimp on the socks and gloves.