I would say just ignore them. (or smile and wave - that's what I do!) You have just as much right to be there as they do.