LIke Veronica said, you're "not in their group." (Or gang, as the case may be...)