We decided to leave them for the babies and then look into removing the nest. They definitely match the picture of a North American Swallow.

DH determined the guy who has set up house in the front tree is a Mockingbird, I know he is protected so he has free room and board.