Off the top of my head -- I find that wool really is best for wide temperature ranges. Sometimes as it warms up during a ride I will realize I don't need all the wool layers I'm wearing but am not so uncomfortable that I have to stop to take some off. I've gotten some good deals on Smartwool base layers at the REI garage (the outlet part of their website). They're not necessarily my favorite color choice but I can live with that for the price.
My most versatile jacket is a Gore unlined windstopper jacket. I can layer up under it and/or wear a wind vest over it for more warmth. Not cheap, but I wear it so much I got a second one when TE was selling off all their Gore stuff. A friend has a similar jacket from Showers Pass that works over various layers on colder days. But for you it might be more cost-effective to keep your current windbreaker and wear a wind vest over it when it's colder. Or go with your current rain jacket, if it's more substantial than the windbreaker.
Also on colder spring and fall rides I will wear a long sleeved base layer (wool) under a short sleeved jersey with arm warmers. So a double layer on my arms as well as my torso. This give me more options as I warm up, since I can take off the arm warmers and still have something on my arms.
For gloves, I have some Gore full finger gloves with a thick fleece lining and windstopper fabric on the outside. When it's very cold I wear wool liners under them. But my hands tend to warm up fast and stay warmed up, unlike the ice cubes with toes that are attached to my ankles, so I will often end up taking off the liners. Those gloves are for this time of year; in spring and fall I am generally okay with unlined windproof gloves (mine are from Bontrager) and the wool liners. Often I don't need the liners at all. Both the Gore gloves and Bontragers are a size too big so there is plenty of room for the liners. It's important not to have tight gloves or socks/shoes because that will constrict the blood flow and make your extremities colder.
Also make sure your wrists are covered and warm, otherwise no gloves will be warm enough.
Another thing -- if you're commuting you probably have a bag or two on your bike for carrying stuff. But if not, a handlebar bag or other bike bag is a must for me in non-summer months to carry the extra layers that I take off as I warm up or bring with me just in case I need them.
- Gray 2010 carbon WSD road bike, Rivet Independence saddle
- Red hardtail 26" aluminum mountain bike, Bontrager Evoke WSD saddle
- Royal blue 2018 aluminum gravel bike, Rivet Pearl saddle
Gone but not forgotten:
- Silver 2003 aluminum road bike
- Two awesome worn out Juliana saddles