I've been riding for 3 years and I think my average speed is about 9.4 mph or something. That's how I roll. It didn't change even during the year I rode 3500 miles.
Don't feel bad!- if you're enjoying biking that's what counts most!