Are the shorts too big? Not pulled up enough? This happens sometimes to me, but it's not frequent, and not really a big deal. I just adjust and move on. If it's a chronic problem, you might want to try a different short/saddle combo.