Crankin,
Normally I'd recommend wearing ONLY wool layers to increase the ventilation, but you are irritated by the wool against your skin, so this is a dilemma.
Wool breathes, which cuts down on the sweating and dampness, yet wool still keeps you warm whether it's damp or dry.

Whatever you can do to increase ventilation will keep you drier. I think it's the damp sweatiness that is making you feel cold. Increase the air circulation and you will feel warmer even if you are not adding layers. Thus, in theory at least, if you remove one of the ventilation-stopping layers, or substitute wool for it, you will hopefully stay drier and thus feel warmer. I feel warm and dry when i wear only minimal layers of just wool- even when I feel the cool breeze coming through the wool fabric i don't feel chilled- and for me that's pretty amazing.
Maybe a layer of silk base layer next to your skin, and then soft merino layers or felted wool jacket on top of it?
That's all I can think of, sorry!

P.S. Cataboo- still chuckling over the sparkle/glitter debacle. Yikes!