It could be a function of your speed. Momentum can make it easier to remain balanced and steady. That said, it's important to be able to balance at low speeds, so that's a skill worth drilling. I also think it takes some practice to look far enough ahead on the trail. The more I look directly in front of my wheel, the worse I ride. Did you get out of the saddle much?