I tend to get sluggish mentally rather than physically. I reach a point where I have to force myself to get on the bike. That's when it's time to do something else for a while.

I usually leave town for a week every summer for vacation, and I don't bring a bike with me. It's sets my conditioning back a bit when the vacation is over but I think the mental break of doing other things (or nothing) is worth it.