What you eat off the bike has as much to do with it as how much you eat, too. Personally I can't tolerate much fat at all during exertion, but you need to make sure you're getting plenty of healthy fats in your daily diet, because your body needs those to metabolize stored fat (among other things).