I think it must be the body type, height, etc. I have had very short hair for ten years, and I am flat chested, but no one has ever mistaken me for a guy. Perhaps it's because I am short?
Though I do see a scary resemblance to my son, who is a Marine, right after I get a haircut .