Rest days stress me out...

When I ran highish mileage rest days didn't really bother me, since there's only so much pounding the joints can take, even the pros take a full rest day every 7 days.

Cycling-being way easier on the body-doesn't make me feel like a need day off, and it seems like even at the local competative level total rest days are unusual-it's more about "active recovery." I rode 186 odd miles this week, ran 15 miles, 3x30min eliptical, and 3 weight training sessions, but I am totally stressed about rest days. I feel like what ground I gain training wise, I lose weight loss wise...

How often should I have a total rest day? Should it every be TOTAL rest (ie, no eliptical, no run, no nothing?) How do I not stress about it without trying to starve myself that day?

(btw, I am not an eating disorder type, I am 10-15 lbs above my ideal weight with a contrary metabolism)