Tell him you'd rather run alone.
Or if he wants to be out while you're running, tell him to run 1 block behind you.

I prefer to run and ride alone, but if I'm to be out with other folks we work out a system (run away/walk back, ride to a meeting point) so everyone is happy.