when I am just going to work my commute is 4 miles downhill, I wear my work clothes.
I pack bike shorts for the ride home (uphill!) and usually wear a teeshirt
or maybe a raincoat too.

For longer rides, I wear all bike clothes because it's easier than hassling with my husband who has a thread on bikejournal about how many bike jerseys he has!
(and wants more of)