Is it just chipped paint? Should I worry?

[Owlie]

Odds are it's probably just chipped paint. Grab a magnifying glass and look at it from an angle to see if there's any damage to the underlying material.

I'd say take a bit of nail polish to it once you're done, but I don't know if you can do that safely with carbon like you can with aluminum or steel.

[bmccasland]

You might want to contact your LBS about getting a small bottle of touch-up paint after you check for other issues like Owlie suggested.