Do you use fabric dryer sheets? They have little particles/fibres of scent that can irritate the skin when the article of clothing gets moist (i. e when you sweat).