I know that we are about to change our primary care doctor and this is one of the big reasons. Our doctor stopped doing primary care and only does sleep studies now. The guy who worked with her brought his wife into the practice; he's just goofy and she's (no offense to anyone) a slightly overweight woman in her forties who questioned me if I had "chest pain when climbing stairs," when I told her I was concerned about my chest hurting/getting bronchitis or pneumonia when I had a sinus infection. It gets worse when you get over 55; I have noticed a distinct difference in the way I am spoken to by some medical people. They speak like i am a child and try to "explain" things like I'm a moron.
It is true that it helps to have a doctor that rides or runs or swims or something! My gynecologist is a tri-athlete; while she has gone a bit overboard (to the point of wearing very inappropriate attire at the health club, causing creepy guys to hit on her) after losing 125 lbs., when I talk to her about my concerns, she listens and totally understands. She doesn't tell me to slow down, even though I have various medical and sports injury things.