My motto is - if I am not part of the problem or the solution then I am not part of the conversation - and I verbalize that when someone tries to snag me into talking about others!
I love this motto!!!!!
In my situation, I barely know the girl who they're always talking about, but the few times I've been around her she's been incredibly kind to me. I tend to just make a statement to that effect.