I have the opposite problem.
Today when I was driving my car down the highway, there was another car in the oncoming lane which was stopped & had their left turn blinker on. I started slowing down- there was no way I was going to go by that car at high speed that was about to turn in front of me and perhaps didn't see me!!! My husband said What are you doing??!! Go! Then I realized i was not on my bike and it was OK to keep going without braking.
I often find myself slowing down during downhills in my car so i won't "lose control"- only I don't need to do that in my car!

That's a scary situation you described. I like the way you handled it though- walking the rest of the way and then going back to do it "right" later.