It's really common for that to happen with mini pumps because you wiggle the thing back and forth to get good leverage. The Road Morph pump or something similar will help with that (there's a platform for your foot) or anything with a separate hose, but those are a bit bigger to lug around.

Change those tubes! Don't ride on broken valves!