Drives me nuts when it is used during a conversation, or disagreement, especially during a "heated conversation". It conveys such a lack of concern or caring.
Along that same line, I grit my teeth whenever someone uses "anyway" to resume speaking in conversation. It's dismissing whatever the previous speaker said so you can get on with what you want to say. Very rude.