Have a bright light wherever you have your full-length mirror, and just make sure the seam's lined up when you dress. It's very difficult to notice then, and if they fit as well as you say, then the seam won't move once they're on.

Life's too short to wear shorts that are more uncomfortable than they need to be. JMO.

(although I'm seriously starting to worry whether "I'm too old to worry about what I look like to other people," is the first step toward "I'm too old to care about other people's feelings," which I see out of so many people... But that's another topic.)