I usually take it off, but then again, my hair is only two inches long! Maybe carry a bandana or a Buff with you, just in case?