I think I would have backtracked, but it's hard to say unless you are in that situation. Safety says stay with a group but logic says back track to a familiar place. I can't believe none of them wanted to go with you and I certainly think it was very irresponsible for the ride captain to say "they'll find thier way" when you told him about the group you were with and that none of you knew where you were going.