Most of my wardrobe consists of t-shirts and jeans so take this with a grain of salt:

I'd keep maybe one or two pairs of pants (that's what fluctuates for me).