I know it is legal in many places, including around here, but I have found car drivers are particularly aggressive in the situation described by VeganBikeChick. You will hear more honking and experience close passing. Whenever I ride with someone else, I avoid that situation.