Fog worries me more than rain or darkness. It really does hamper visibility, even with good lights, and reduces drivers' time to see and react to me.
For me, it depends how dense and how low the fog is. Low, dense fog is a no-go for me. Less dense fog is usually a game-time decision.