Neither pair of my PI arm warmers has silicone grippers. The fleece pair has very light elastic inside the top seam, and the wool ones are a stretchy knit all by themselves. They stay up fine.

(My DeSoto arm coolers have silicone grippers, which actually don't irritate my arms the way silicone grippers on shorts irritate my thighs, but the DeSotos are such a weird shape that they don't stay up. Fit, fit, fit.)

And with arm warmers, you don't have to peel them all the way off. You can just push them down around your wrists and either have them available to pull back up if it cools off again, you start a descent, etc., or take them off safely whenever you break for another reason.