I don't care how old you are, people (especially nasty ones in high-up positions) will find a way to make you suffer if you are one degree below the nicest of polite. I wouldn't do it.

Another way to say "it must suck to be you" is to not give his opinion much credit. He's just one guy, and most people don't listen to negative whiney opinion (or take it that seriously.) You can't change people. You can only show them how cool it is to be a cyclist. Show, rather than tell, is key.