Ice, ice, ice. Really, it helps.

Make sure all the stingers are out (butt, too!). I had one in my breast once for about a week, because I wasn't 100% sure it was still in there, and I was too shy to have anyone check for me. It itched the whole time. Finally it came out on its own, completely shrivelled up, depleted of all poison