I wouldn't even bring that up to another female coworker. I can't believe he thinks it is OK to pry into your personal life. I think I would just tell him that unless he has questions pertaining to work not bother you with personal questions because it isn't work related. It may seem blunt but obviously he's not the brightest so maybe you just need to spell it out in non condescending terms but be firm.