What kind of valve (presta or schrader)? Could be the cap - I agree there's no harm in leaving it off. I'm sure you're already doing this - but if it's a presta, make sure you're screwing the little lock down all the way.

CA