I'm not sure I would feel comfortable with "stranger" males in my house, if I was alone. Usually, the common denominator of cyclists makes me less wary, but really, one never knows. I am not unusually cautious about stuff, but I don't think I could do this.
Of course, it's a moot point as my DH would be even more uncomfortable and never want to have people he doesn't know in the house. He wouldn't be "afraid," but let's just say his expectations for neatness are high and this would stop him. I'm kind of the same way, but a lot more flexible.