Those don't sound like smug reactions...they sound like people expressing their own inner fears/limitations. When they say those things to you, you don't need to respond at all! Except maybe to say, "yeah, i can't wait to get back on the bike!!"
Speedy recovery!