Are you eating within half an hour after you finish a ride? Your body's ability to restore muscle glycogen starts falling off after half an hour, and is back to baseline about two hours after a workout. If I don't refuel within that period, I'll be ravenous for days.