You sound JUST LIKE ME! Which in this case is not a good thing!
I have a real problem with sitting back and healing when ill or injured. But over the years I've learned that I must let my body heal. Basically don't jump back into any real training until at least TWO days AFTER you feel fully recovered. And yeah, 4 days is just a taper girl! You don't lose fitness that fast. Actually in my Ironman tapers I feel really crappy during the taper. Very weak and out of shape. But that is just my body repairing itself. When I hit the course my body is fresh and ready to go.
I think the science on this actually says two weeks before your fitness starts to decline.
Just do some easy around the hood spins to keep your mind at ease. It will also allow you to maintain your base. Just short stuff, no intensity. Think "easy breezy spinning"...
Heal up!
Denise