I would fill them with warm water & some baking soda and let that soak for awhile. Then rinse well. I do this all the time with my narrow mouthed Nalgene bottles.

Kerry