You'll definitely want some base layers for the cooler weather. They're not cycling specific. I wear my wool base layers under everything (and sleep in them, too).

Shoe covers are nice, but plastic bags inside your shoes are fine for shorter or very cold rides.