I second what spokewench said. Sit down and talk with them about how everyone needs their own time and their own passion in their life, especially if it is something that is good for them. Maybe they are just afraid that you are going to be spending less and less time with them. Maybe you can all agree on a compromise schedule that you can all be happy with. The solution has to be a compromise, not go all one person's way.