Oh there will always be people who are the Debbie Downers. One friend I have worries I'll be kidnapped or run over when I ride alone on remote country roads. I have mace, a bike to wield as a weapon, and a legs for kicking. Not saying it can't (and hasn't happened), but I'm not going to worry myself about all the things that can possibly happen. I'm prepared and aware of my surroundings. If anything ever happens to me- at least I was doing something I loved.
Ride on!