We live 3 miles from a golf course. My DH collected the golf balls and always had one to throw when dogs were bothering him. He wouldn't throw AT the dog, but in front of it. It would distract the dog enough to buy him time to get down the road.
We've had a lot less dog problems as of late in town. It's when we go somewhere else. And i've gotten off my bike more than once, that method works.
I wouldn't give dogs treats for chasing bikes either. That's not a good idea.