I would go see a dermatologist and ask for their professional advice. Chlorine is extremely drying to your skin, but then again, so is basking in the sun.

I immediately thought that Vasoline would lock in moisture, but it seems you are already doing this. Any chance you can do fresh water swimming instead?