Thin layers are good, as noted. I would add that what you need depends a bit on what kind of rides you do. The most challenging isn't really suiting up for a short cold ride, it's starting in cool and maybe wet weather and ending in warm weather, without being loaded down with extra clothing. For rides like that, typically longish rides spring and autumn, stuff like arm and leg warmers and removable toe covers are great. My dh calls it "the modular look"

For shorter cold rides I find regular long-sleeved and "long-legged" clothing more comfortable, but less versatile. In cool weather you need thinner layers than you might expect, but to cover more then you might expect. Feet, hands and head get cold fast, especially feet if you have snug shoes.