I don't generally toss anything. But on rare occassions where I do, I don't feel bad if I can answer three simple questions:
- is it natural?
- will it rot quickly? Example - nothing rots in the winter, so it matters
- will it create a hazard? Example - banana peels in the roadway

Yes,Yes, No, brings little guilt

JMHO