It might be your derailleur too. Try loosening one of the screws (the outer screw limits the outward movement of the derailleur, and hence the chain, and vice versa. The looser the screw, the more sideways movement the chain has).