I totally relate. That's the main reason i don't do clipless. I too stopped keeping track of my mileage and speed this year.
I believe that ideally biking should be a normal part of everyday life, not some elaborate and expensive ritual that we have to prepare for or drive to. I sometimes sense a big separation between those whose riding is competitive/sport, and those who ride for practical transportation or just for fun and fitness. When i see the complicated preparations that go into some people's rides, it makes me wonder how they can still call it 'recreational riding'.

i think it would be healthy for everyone to once a week just jump on their bike exactly as they are (just put on your helmet and gloves for safety) - no special clothes or shorts or shoes, no computer ....and ride around the block a couple of times or to the store for a quart of milk. What a liberated feeling that would bring!