yep, don't give up.. I see that you live in Bayside- Queens right?? I'm trying to think of an area that's somewhat traffic free..hmm... Heck, to bad you couldn't take the bike over to the city and ride central park. It would get you used to dodging people- pretend they are cars (kids are mini coopers )...
But yeah, I don't think you should give up. Just try to ride when traffic is a bit lighter- early am on weekends perhaps. And I'm thinking that if *he* is making you nervous, then maybe you should leave him at home until you get a bit more confident. It sounds like his energy is freaking you out...
Good luck! Hey, I kNOW you can do it!!!