Is your jacket wicking also?.......if your jersey is doing its job and moving the sweat to the outside but the jacket isn't wicking material - you'll get wet. Also, the hardest thing for me to remember is - I Will acclimate. I always feel so cold when I start I was dressing to stay warm up front and then ended up being overdressed in the end. I have since found its easier to start out a little chilled. Today the wind chill was 33 and I was riding in a 14 mph headwind. I wore a tanktop, armwarmers, jersey, PI jacket, shorts, and windresistent pants. Also, wind-resistent gloves with liners and socks. I still had problems with my fingers and toes but the rest of me was quite cozy and I could - if I needed to - take the jacket off and slip it in my back pocket. Same with the warmers. You also might try unzipping some of the layers - vent some the heat out when you can - see if that helps.
PS: Tell me about being cold - I've been wearing turtlenecks to work since the highs dropped out of the 70s and I keep my AC vent closed in the summer coz its too cold for me. Sleeps with electric mattress pad And a goose down comforter in the winter and our avg lows are in the 40s!