If you don't have a soft (dead blow) hammer (rubber mallet), put a small piece of wood on top of the stem bolt (or whatever you happen to be hitting with a metal hammer to loosen it). That'll soften the blow as well as reduce the chances of flying metal chips.