Why does your husband need/want you to be with him all the time?

There is something unhealthy going on there.

Is he stressed about taking care of things/children in your absence?
Is he feeling concerned about your committment to him or the marriage?

My experience is that it is very healthy for both partners in a marriage to have some seperate interests or activities.