Some helmets generate more noise than others. I had one that would actually sing a bit in the right (or wrong!) conditions. I abandoned that one to my husband and it didn't whistle on his head.

Anything you put around your head or ears will change the airflow. You might just have to keep trying different things until you get it worked out.