I have never had this problem with my ff gloves, and I wear them a lot when it cools down.

Maybe try a different brand? Or wear them several times and see if they loosen up in the right spots? How do men's gloves feel when you try them on?