Is it because you sweat it off? If you want something that works and doesn't sweat off, try Bullfrog. It's kind of a slimy thing, but will stay on! I use it when I'm going to be in the water.

I'm what I refer to as "ghost white", so I know where you are coming from. Good luck!