I don't doubt that their memories are good, but they'd probably react the same way to an unfamiliar shelter just from smelling the pheromones of the animals inside.