I would not eat those "extra" calories.

How do you feel during and after those rides at your current caloric level? If you're hungry or feeling wasted, eat more. If you feel great - don't!

Veronica