What would be too much too soon?

[Pedal Wench]

The general rule of thumb is that you should increase your mileage by no more than 10% a week. That being said, listen to your body. You're starting from a better aerobic base than most beginners, so you can probably stretch that.

Edit: Well, what Grog said!