According to this chart, frostbite isn't a concern until it is 10 degrees, and then only if the wind is 55 mph.
wikihow recommends keeping children in if the temperature drops to -13F!

Good luck getting them out of doors!

Maybe some kids, especially these days, don't really know what to do when they get outside. Perhaps you could organize some games & fun races?