I only have one pannier; I never envisioned doing major grocery shopping, so it's been fine for my short forays to various specialty stores.
But, it's amazing how heavy a few things feel when you are riding up a hill.