I was going to suggest something similar to Lisa. Many synthetics will retain stink no matter what you do to them. I think this is why so many chamois fabrics are treated to prevent bacterial growth all together. I'd suggest trying to replace that panel with a more natural fabric that is still wicking (soft wool, perhaps??).

But definitely try white vinegar first...that stuff works miracles!

I'm so sorry that person said such hateful things to you! If he/she really does know you in real life, rest assured that they are clearly a spineless coward if all they can do is make annonomus and riddled insults about you on an internet message board! If they don't know you, they are even more pathetic. Don't let them get to you!!