I wouldn't want to drink out of aluminum, either. If you don't mind other metal, the SOMA Commuter's Coffee Mug is stainless inside. The lid is plastic, unfortunately, but it is designed to be drinkable on-bike.

For glass, you could get a glass bottle like this Lipton Iced Tea with dimensions that would fit well into a bike bottle cage. Punch a hole in the lid and stick a long straw down to the base of the jar. It wouldn't be completely leakproof, but I think it would work.