I think the difference is that you try to not take time off but you had to this time and your reason for taking it off isn't to ride.

I've called in sick before and gone out for a walk. Moving around is good for you is how I justify it.

Maybe riding doesn't help your condition but it does help your health. Right?? I think you're fine.