My daughter (then 17) crashed a couple of years ago - at slow speed, a truck came behind her, she got nervous, went too far off the road, lost it in the gravel and fell at relatively slow speed.
Her wrist was aching, we slathered it with arnica, but it was still sore two days later to the point of slightly teary eyes (she is very brave). We went and got it xrayed, but even though there was nothing at all visible on the film, the doctor recommended and temporary cast and explained how the break can be very fine and may not be visible for a week or so. Thank goodness we had a cautious doctor. Sure enough, she had a fractured scaphoid.
A very hard few weeks ensued - a Hawkes Bay summer is frustrating to endure in a cast...
She has healed well but still gets occasional aches in her wrist. Sorry NMT, but her priority wasn't cycling so I can't tell you how quickly you could do long miles on a bike, but even after the 6 weeks in the cast, it was months before she could put too much weight on her wrist - so go softly softly.
Zen... even if bones didn't have nerves (I hadn't thought about that Wahine) the tissue, muscles etc around bones would be damaged and bruised and pushed outta place - I guess thats why it hurts.