Bike riding imitates life.
It's all about communication.

You've got to establish the goals of the ride *before* the ride. If someone wants to hammer - fine - so long as that's expected beforehand -- "Bye. Wait for us at the next rest stop." Group rides can be delicate balancing acts - especially if the group differs greatly in ability. Pity the guy doesn't talk.