I think one other thing to consider is that effect that intense or high-volume exercise has on your appetite. When I had the time and energy to ride 5k+ miles a year (on top of yoga and some resistance training), I was hungry all the time. Plus, I had to eat a fair amount to even sustain that level of activity. I find it far easier to lose a few pounds with more moderate exercise as it seems easier--at least to me--to maintain a modest calorie deficit.