I used to have a HUGE fear of lycra. And bike jerseys. Hated them both. My boyfriend loves to tease me about that considering my short and jersey collections have become quite large. Once you start realizing that they are really the proper tool for the job, you'll feel more comfortable. Someone else mentioned that they act like a girdle - so true. I mean, really, fitting tightly, they're going to give you a slimmer profile than baggy clothes. Again, who cares what anyone else thinks? They really make biking more comfortable, which means you'll stick to it. I started out with a pair of baggy mountainbike shorts, but the extra material wasn't very comfortable.

All that being said, wear whatever you can to make sure you stay riding. If you're comfy riding in your bathrobe, then go for it. Just ride...