Anyone have problems with carbon frames cracking or breaking?

I'm starting to look at getting a new bike. I love my old Cannondale R500, and the aluminum frame suits me just fine, but after a decade, I'd like an upgrade.

I had an incident recently where I hit some potholes at full speed on a century ride. No avoiding them, bikes to the left and right, and I hit so hard my handlebars pivoted down! I was really scared that I had damaged the frame, but she held up like a champ.

In chatting with folks, they say that kind of hit would have cracked up a carbon frame, which honestly scares me. Is this really a valid fear, or is the chance of that happening unlikely?