I suggest you ask the other cyclists who are riding that road how they handle the situation. Ask at least 6 of them, and you may get some valuable cycling technique tips. You may not realize something that you are not doing to make things safer for yourself.
Also, invest in a couple of screaming neon yellow cycling tops and wear them. Drivers often slow down to tell me they could see my neon yellow a mile away and how great it was to see a biker clearly. It can make that little bit of difference, safety wise.