You don't have to get cycling-specific gear. The best cold weather piece I have for commuting and cold-weather recreational riding is an old cashmere cardigan sweater that I got at a thrift store. It has holes in it, which is good for riding. I layer it with a non-cotton long sleeve shirt and either a shell or heavier jacket depending on the conditions. Usually a shell is enough once I get riding. I can unbutton and button as needed.

You can wear a thin hat under your helmet, or get an band that just covers your ears. I wear cycling shorts and tights because I have them, but thrift-shop wool slacks over cycling shorts will do fine. Just be sure to secure them at the ankles to keep the fabric out of the way.

Gloves you can get just about anywhere. I like ski mitten/gloves; you can also layer gloves and mittens.