File gently. You're right you don't want to be tugging on the skin. But you need to get the dead skin off or it's only going to get worse. That's one reason why I recommended the Microplane (besides its being a high quality tool, made in France): it's meant to be used when the skin is dry, unlike some other tools where you have to soak first and there's a lot of pushing and pulling.