Do it! College cycling clubs are great! You'll have plenty of time to study and work the rest of your life. New friends and great memories at a great time in your life. Winter training can be fun with a group, and a coach can really help your cycling. I wouldn't worry to much about the racing, just enjoy the activity with other cyclist.