In the past I've had good luck treating fungus infections with topical probiotics. If you're allergic to milk you probably don't want to use dairy yogurt, but maybe some unsweetened non-dairy yogurt or just open up a probiotic pill and suspend the powder in water to apply?
Good luck, anyway, that sounds miserable.