I always thought the inclusion of eggs in "dairy" came from the fact that they're kept in the dairy case, is all - and from back in the day when people understood that vegans were vegans, but there were also vegetarians who were not vegans but kept "non-dairy," which meant no eggs either.

