I have that problem with my shorts. I figured it was rubbing against the seat - didn't think to check the velcro! Out to the garage with scissors next...