I think stiffer soles would matter if you're doing long rides or you want to go as fast as possible.

Otherwise, if you're comfortable, then it seems like your current shoes are doing the job.