That's not an easy thing to do. I'm an "avoider" and hate confrontations regardless of the situation, so I know how difficult those conversations can be. Thank you for making the effort and telling them. You could have very easily just told them no without giving a reason.