You are not alone.
In addition to my regular day job, I am a musician who performs in paying gigs on a fairly regular basis. My husband is as well, and we play music often with other musician friends.
However, when I'm not actually playing music, I prefer to not hear background noise/music/talk etc. I detest being forced to listen to other people's choices of music wherever I go.
We very seldom even play cds at home, unless we are trying to learn a new tune or something. We don't watch tv.

I like to hear the quiet and the naturally occurring sounds around me. It's becoming harder and harder to have that choice in our world.

I like to hear a cricket, the breeze, the pretty clink of silverware and low discussion in a restaurant, cat paws trotting across the wood floor, a blue jay in the yard, the clicking of my bike gears and the zing of changing my gear rings. The sound of my tires on asphalt or sand.
I find these subtle unpredictable environmental sounds to be very pleasing and they don't distract me from my own thoughts.