Although you're already showering immediately after a ride, it might help to use some kind of antiseptic/antibiotic cleanser for a while in addition to regular soap, to make sure you're killing any bad bacteria that might be causing ongoing problems.

http://www.mayoclinic.com/health/boi...SECTION=causes