Some of the stronger people on my team are in the 40's and 50's - its definitely not too late (I started last year and I'm 35). Check out some local clubs/teams too find out about the racing scene in your area.