Whatever makes you happy, comfy, warm and dry!
I ride with a bunch of ex- and current XC racers (some former pros) and everybody wears lycra everything. The only people who routinely wear baggy shorts and leg warmers are the older guys who just haven't been able to convince themselves to appear in public in lycra. There just don't seem to be any fashion issues with anyone I ride with.
Have you tried knickers? I love Shebeest's knickers for mtbiking.