IMO, that's why I don't use fins and don't like them (for the reason you stated- swimming with paddles and tablespoons).
I don't use them now because I don't like to rely on that propulsion when I can't use it in events. I like to make my legs stronger on their own w/out the added push (although that's taken far too much time in the pool to achieve "naturally" ). It's too hard for me to get used to swimming w/out them and feeling the frustration of going from jet propulsion to tiny bug propulsion. It's like the difference I feel when using hand paddles and then swimming with my bare hands. Good for builing skills, but painfully slow when trying to swim without them.
A girl I know uses the zoomers and really likes them. I guess it all comes down to what you want to get out of it. I think your fins are just fine for building stronger legs/kicks. If it's hard to go between having them on, and swimming bare, maybe try to ween them out of the rotation. Perhaps just use them once a week. I don't know- just thinking out loud.