Is your jacket wicking also?.......if your jersey is doing its job and moving the sweat to the outside but the jacket isn't wicking material - you'll get wet. Also, the hardest thing for me to remember is - I Will acclimate. I always feel so cold when I start I was dressing to stay warm up front and then ended up being overdressed in the end. I have since found its easier to start out a little chilled. Today the wind chill was 33 and I was riding in a 14 mph headwind. I wore a tanktop, armwarmers, jersey, PI jacket, shorts, and windresistent pants. Also, wind-resistent gloves with liners and socks. I still had problems with my fingers and toes but the rest of me was quite cozy and I could - if I needed to - take the jacket off and slip it in my back pocket. Same with the warmers. You also might try unzipping some of the layers - vent some the heat out when you can - see if that helps.
PS: Tell me about being cold - I've been wearing turtlenecks to work since the highs dropped out of the 70s and I keep my AC vent closed in the summer coz its too cold for me. Sleeps with electric mattress pad And a goose down comforter in the winter and our avg lows are in the 40s!
Life should NOT be a journey to the grave with the intention of arriving safely in an attractive and well preserved body, but rather to skid in sideways, champagne in one hand, strawberries in the other, body thoroughly used up, totally worn out and screaming: "Yeah Baby! What a Ride!"