You could carry one of those small cans of pepper spray. They're lightweight and you could probably rig a way to carry it on your handlebars if you didn't want to put it in your pocket.
And you could also use it to zap harrassing drivers!