It is NOT your job to make everybody happy. Some people simply do not like even the least bit of inconvenience to their choice of lifestyles. It's hard... it's natural to want to harmonize with everybody. However, some people simply don't understand (or don't care) that they aren't the only creatures that matter.
When I'm feeling vulnerable like that I think about other people who've been disliked simply because they try to co-exist and live their lives (or people who live in lousy neighborhoods), and people (or other living things) who are victims of others' "needs."
I also figure that every time I go back out there, anyway, I'm asserting that no, the folks who are pissed off at cyclists are not going to bully me off the road, at least not right now, and I"m asserting to the non-jerks that yea, that's right, there are cyclists who use the roads and enjoy it - and if they'd design the facilities better, I wouldn't be so mujch in their way.
Oh, and except for people who already don't think you belong there, PERIOD, don't get *too* far over if there really isn't room to pass. It's not as safe and they can't see you as well. Mirrors are excellent... I will ride out in the lane and then if a car's coming and could go around me safely, I"ll move over some - then they think there's even more room. It's tougher if I really know that there isn't enough room (like going over overpasses).