Yes, necrosis of the jaw bone (what they used to call "fossy jaw") is a potential side effect of some of those drugs.

If you keep a healthy level of circulating calcium, the body won't have to draw on bone stores to keep the calcium levels in the bloodstream (and consequently other tissues) at the right place. There's probably a reason they tell you not to use bisphosphonates (at least, residronate) if you've got low blood calcium...