There are some weight limits to carbon that does make it a less than suitable material for building up a loaded touring bike, and it may not be the best material for a bike you are going to abuse and know that will be crashed often (like a cyclocross bike - I'd leave the CF to the sponsored pros who don't have to pay when they break something) but I essentially agree with Andrea.

I also have a carbon bike for racing. I don't feel in danger on it, and I've even crashed a few times without breaking anything. It is actually pretty tough stuff (its not going to break from tipping over when its parked...), its just that when it breaks it does so pretty spectacularly. The technology has come pretty far since the early CF bikes too, which I think may have been a little more prone to early failure. And I also agree with her that any material can beak. I have a teammate who has had unfixable failure of not one, but two titanium frames - and she's not particularly a heavyweight at about 5'2"... My husband broke a weld on a steel bike and the repair would have cost more than a new frame...