I use a homeopathic silica tissue salt for "the temporary relief of pimples, boils, ulcers," etc. and find that it really works well for me. I tend to get very big, deep, hard sores and after a few days of the silica pills feel much better. The brand I use is Schuessler, but I bought them in Australia and don't know if they are available in the US.

Good luck.