I'll second the notion that if you're on a budget, you can use general fitness gear in place of biking duds. A cycling-specific jacket was a must for me because I'm tall enough that in my riding position, a normal jacket isn't long enough. Almost everything else, though... I've worn lined track pants on the bike in winter with the right leg tucked into my sock.