If I remember correctly SPD's are designed to disengage with either an inward or outward motion. I don't think it's "wrong" or that you are hurting anything. Do whatever works for you.