When I was in school, I would ride to campus from student housing each day...it was only about 2 miles away, but even at such a short distance, the crotch seam of my jeans was more than uncomfortable...any consistent bike riding, even in short spurts, benefits from functional bike clothes...

What if you were running/jogging to work? Would he expect you to go the distance in your business attire?

Some people are just stupid...next time, tell him to kiss your well-padded bike-short cladded a**!