When this has happened to me, I sent an email out to all the people in the office explaining "fridge ettiquette" and noted what was "swiped" of mine. To this day, I have never had anything else taken unless the person wanting it has asked me for it. I think making the person aware that YOU are aware, even if you don't single anyone out, makes them more considerate of their actions.

It worked for me anyway.