I keep some pepper spray on my frame where I can grab it, plus a cell phone with me. And always tell someone where you are going to ride that day. If you live alone, leave a note on your kitchen table as to where you are riding.
If you encounter anything remotely suspicious, pedal in the other direction immediately rather than being afraid to look 'foolish' by turning around.