The Soma crystal bottles are BpA free, and don't mess with the taste of your stuff. http://www.somafab.com/bottle.html I have some pretty old and well-loved ones, and they are still fabulous.

And everything else Nalgene makes other than the polycarbonate bottles is BpA free. http://www.nalgenechoice.com/

Be careful with stainless and aluminum. Some brands are lined with BpA plastics. So if you are concerned about BpA, steer clear.

I haven't thrown out my PC bottle yet. I'm thinkin' geocache, first aid kit, bike part container... or drinking from it.