My sister lived in Atlanta during the summer Olympics back in 1996. They were worried too, but it turned out to be no big deal. The traffic and public transit was more packed than usual, and they avoided some areas, but their daily life wasn't really affected particularly.