I think I just don't see enough men other than business wear/business casual (where I work) or outside of their cycling clothes, casual street clothes. No, the guys I know don't wear baseball caps regularily at all.

I probably live in a sheltered/narrow world.

Just a small amusing point: Dearie's son who will be 35, occasionally wears a wool toque, yea..in his butcher sandwich shop that he runs. Dearie believes his son is trying to hide his balding patch of hair at back of his head. Dearie is polite about it and doesn't egg him further.