I've had both silk long underwear and thin merino wool under layers.
Silk snagged and fell apart after a few months. It was not nearly as warm as I had been led to believe. And when I got even slightly overheated, they felt clammy and cold when damp.
My merino base layers are 100 times nicer and keep me way warmer, breath nicely and don't get yucky when damp.