Have you been reading crazyguyonabike journals? I've read about people who hide their panniers somewhere, if they're wanting to see a National Park for example. If it's a touristy area, maybe you could rent a locker or leave your panniers at the lobby of a hotel. In a museum maybe there are lockers for that sort of thing.