There are thingies designed specifically to go under helmets to cover your ears - they are the kewlest. They just go around the straps where your ears are. Now, if I could remember their names...
... oh, a Google Victory 'cause I remembered Mike Bentley linked to 'em
V-Muffs
http://www.mapleshademercantile.com/ordering/