Hmm...could it just be the way you're putting it in the stand or holding it? Do you have a computer or anything on one side to add a little bit of extra weight? It seems sort of normal for the front to swing one way or the other.
You said you heard some noise...does the bike feel sloppy at all? If it's feeling sloppy, maybe your headset is loose. Did you check that? Here's a website that tells you how to check it....
http://www.caree.org/bike101headset.htm
I'm not a mechanic, just some thoughts. Good luck!