Might you be allergic to the material used in the band? My skin is very sensitive to some things and I would have a reaction similar to what you describe from any type of wool and from some synthetic fabrics.

I got little red itchy bumps on my forehead from my helmet. I read up on acne mechanica and employed the tips this page suggests...

sports acne

but it sounds like you are already doing everything preventive.