Perhaps you are not centered on the seat, or you have one shoulder higher than the other and that affects your sitting position.

Or, as in my case, you have one leg that is longer than the other. My fitter figured this out and adjusted my bike accordingly (with a shim or something).