You get used to people looking at you. And the more they see you, the more used of people wearing bike helmets THEY're going to be, and then they will also move closer to wearing helmets themselves or suggesting helmets for their children.
If I am going to be somewhere for a while (like a restaurant) I take it off; but if i just run into a shop, I'll leave my helmet on.