Plain ol' cancker sores are a big problem, and you can also get "bald spots" on the tongue.

Celiac causes the villi on the small intestine to flatten out (go smooth) and the same thing can happen to the surface of the tongue.