Do you have your recovery snack within an hour after the end of your ride? Your muscles are primed to replace the glycogen you've burned, but the window starts closing half an hour after you stop, and returns to baseline within about two hours. For me it manifests in both ravenousness and lethargy for four or five days, if I neglect my recovery nutrition, although it usually does take a longer ride/run for me to deplete.