I say GO FOR IT!

It's scary, I know... But I'm sure you won't regret it. It is a learning curve from the hybrid to the road bike, but with the right bike - which it seems like you're getting closer to - you'll be fine, fast, and have tons of fun.