I really hate to be the one to suggest this, but I think you probably have a dairy allergy that is getting amplified by someting about this particular cheese. Or perhaps it is processed by the same equipment used to make something you are allergic to and is cross contaminating the cheese.
Food allergies are not related to seasonal allergies except that people with one are more likely to have both. I have over 20 food allergies AND 20+ "airborne" allergies. Unfortunately the only treatment for food allergies is avoidance.
Good luck. Hope you are can find a cheese you enjoy and tolerate.