I had this problem when I rode both unloaded and loaded on my tour. When I was in granny gear, the gears would jump off the cog,leaving me with the possibility of a broken chain.

Turns out it was both crappy cables (got them replaced) and a bent derailler (had to buy a new one)--there were no problems after that, so good luck!