We'll go out at 20-25, but not higher. And, only if we are really itchin' for a ride. My tolerance for wind is higher in the spring than in summer.
Our windiest ride was 25mph winds with gusts over 35. I only remember because it was on vacation and we had to get from Point A to Point B. No options. It was only 35 miles, but it was the hardest 35 miles I ever rode. At one point, we started climbing a long sustained 5% grade. The hill blocked the wind. It felt like we were riding downhill!