If you do get dirt in the cleats run a thin wire or a very small screwdriver between the cleat and it knocks the crud right out.
I carry a paper clip on my shoe in case I need to dig out the dirt. The clip is always there so I don't have to think about it, especially if I'm a good girl and use my cleat covers. I have Speedplay Zero's and I love them.