That's a tough issue that many of us deal with (sometimes it's reversed, too). I'm much slower than my DH.
We usually ride separately - which doesn't bother me. He can be on the grumpy side when riding at my pace (he says he isn't - I say it is), and I can't keep up with him. He'll make comments to himself after climbing a hill like "that was easy" - he doesn't mean for them to be hurtful as I huff and puff, but they are. So, to keep peace, it's usually solo for us. Sometimes we do shorter rides where he'll ride with me. We also bought a tandem - which comes with its own set of issues (cadence, not feeling like you're putting forth enough effort, etc).
Could you ride part of the ride together, and then let him take off? If you can comfortably ride 50, you'll have no problem with 60.
CA
Most days in life don't stand out, But life's about those days that will...