If you get a shoe made for mt bike style pedals you can use them just fine without a cleat installed. In fact, most shoes made for recessed cleats have a piece of rubber covering the area that you install the cleat that you have to remove to use the cleat. They don't have to be terribly expensive either. Around her you can usually find a pairs of touring shoes or mt bike shoes on sale for $20-$25 if you look around. Many look very much like regular walking/hiking shoes.