I think when people are scared they like to blame the activity instead of admitting to the fear themselves. It is so much easier to say bike riding is unsafe then to say I am scared to ride a bike in traffic. I don't think your friends meant to offend, I think they are scared to ride a bike.
Jones