Maybe I'm alone here, but I find having all those nerdly metrics from my Garmin (HR, speed, distance, the whole she-bang) part of my fun. BikeJournal (primarily by signing up for different "groups" like the Commuter Century) gives me the incentive to do more, to improve, to challenge myself.
Fast rides with the club are a hoot.
Slow rides with friends for sight-seeing and lunch are fun, too.
It's all good. Why on earth would I be a regular bike rider if it weren't fun?? It's not like I get paid to do this.