Heck no, you're not a sissy! I would be nervous on that stretch, too. You gotta feel safe, and if you can't then you find a away around it so you can still commute- even if it's a few miles less.
I stopped commuting to work because of a scary spot mid-way of my commute. It's a place where the homeless people sleep and there's really no way around it (without adding about 5 miles to my already long 26 mile commute) After being yelled at and scared, I decided it's not worth my nerves being shattered. I'm going to find a new way, but when I'm ready. You go with your gut, like Tahoedirtgirl said, and do what feels safe to you.

Keep at it, tho and keep enjoying those commutes!