Why not just keep an old coffee can or similar container on your counter top for items like that?

Coffee grounds and eggshells are especially good as compost.
Not chicken skin or meat, though.