Check the tension spring on the rear derailleur. Sounds like there may not be enough tension on it.

Books - Zen and the Art of Road Bike Maintenance.

V.