I picked up a Sugoi LS top last year from REI that is not fleece lined - it's a thermal weave. I find it's not terribly warm for really cold days - it's sort of an in between cool-weather shirt (50-60 degree range). I don't recall the specific "model" but you may want to check out that brand.
And I agree - arm warmers with your regular ss jersy work well. Adding a wind vest helps, too, if it's still a bit cold for you.