You don't have to be perfect to ride your bike. Just go ride and enjoy yourself, already! I seriously doubt that the other riders will really pay that much attention to you. If you get dropped, so what? Keep at it, ride, you'll get stronger. But I suspect you know that already.