I would say it is worth it. I am on my 3d carbon bike and the first 2 had various falls, minor dings, put in the back of my car with no ill effects. Do you need carbon? No. But it feels really nice. My first road bike was aluminum and that was the worst for me.
I do also have a titanium bike, which is smooth in a different way. More expensive than carbon, though.