That sounds like something I would have said as a means of trying to make conversation. I can see how it could be an insult, if it was meant that way. Of course, it depends on how it was said.
That's what I'm thinking -- could just be an attempt at some small talk. Besides who cares what other people think? Just enjoy the ride.