As soon as your bike is dry, you can gently dust a lot of that junk off.
It doesn't STICK mostly, it's just sitting there. When you get home, clean your chain with a rag.
It drives me crazy to see my bike get dirty too, but even though it's a steel bike I'm not too worried about it rusting, because I keep it inside when I'm not riding.