If I didn't ride in the wind, I'd never ride. I used to hate it, now I kind of like it. Here are some things I've learned that might make it better:
First thing you want to do is not wear a windbreaker. Wear the tightest jersey you have instead. You don't want anything that will create drag. Tuck in tight on the bike. You know how Dave Z. looks riding a time trial? You want to look like that (or at least feel like you look like that

)--aerodynamic. I usually ride in the drops when it's a head or cross wind. If I have a tailwind, I'll sit more upright to let the wind push me.
Then, you need to imagine that you're moving forward with every pedal stroke. Focus on the momentum forward. Tell yourself you're moving forward. Lie if you need to.
I used to have a computer. Seeing that you're only going 12mph on a stretch of road you usually ride 16 on is defeating. Put your computer on something other than speed.
Next time you're bike shopping, try test riding on windy days. Some frames are better in the wind than others. My first bike was awful in the wind. I couldn't believe how much better my new bike was when I got it. It slices through the wind like a sail.
Riding in the wind is kind of a lot like climbing. You get stronger the more you do it, but some days are just too windy. If tree branches are falling, it's most likely dangerous. If the trees are just blowing, and there's not a lot of debris falling, go for it.
Edit to add: wear something over your ears! Hearing the wind loudly makes it worse. I wear a headband to dampen the sound.