I really don't understand why some of you don't just turn to the person and say "Would you mind not drafting? I'd really rather ride by myself." It doesn't need to be rude and you don't need to change your ride for them. You're letting them control the situation.