I've experienced this phenomenon, also. I go away, exercise some, but not as usual, eat a lot, and come back the same weight. Sometimes I think it's because I am usually walking a lot on a vacation, and maybe a little bit of riding.
On the other hand, I gain weight just looking at food when I am at home.