I just spent $200 on new sport bras, socks and tank tops (essentially gym clothes) and flinched at spending $10 on a skirt for work. I also choose my attire for work based on how well it will cover my sport bra and shorts, generally worn all day under work attire.
I have been know to traverse around in PJs, but not in a cool way, just the "I don't care. I just got in from a long ride and am comfortable and need a bottle of wine and some popchips" kind of way.