It sounds like you're letting your DH's fear get into your head?

If you have the carrying capacity, get a SPOT device. That should alleviate both of your issues.