When I commute or do light shopping, I'm like Deb: 1 pannier.

No damage. I do tend to overstuff it because I get last minute brainwaves, to go shopping after a ride. When it's true shopping load, it must be divided among 2 pannniers.