The use of "my" grates much more than the use of "girl". Some people use "girl" all the time. I consider it a diminutive or casual term, fine for friends or in a very casual sense, but not really appropriate in a lot of settings.

I have a personal crusade to get people to use the term "woman" in all settings where they would use "man" to describe a male Especially in Norwegian, a female stranger is usually described as either a "girl" or a "lady", whereas a male stranger would just be a "man". I'd really like to see the neutral term "woman" be used more, because it doesn't hold any connotations.

No, I don't get miffed if a male colleague calls me a girl, or us female colleagues collectively as "the girls". But I'll respond by calling them "boys"