I've also experienced this, but it doesn't happen when I ride my #1 road bike. It happened when I rode my Jamis Coda or the old Voodoo I used as an around town bike. I also noticed it when I first got my Guru, though now, it doesn't happen.

I think it's something about the geometry of the bikes hitting me, as well as being someone who easily bruises.