a cyclist I know broke his hip because his load was so unbalanced. Of course you can ride just fine with an unbalanced load but you are better off with balance in case something goes wrong.
A friend of mine had trouble clicking into her pedal with an unbalanced load. Her bike went down TOWARDS the load (and the cars) which scared her half to death.