I had the issue with gloves, too. I can't wear gloves with any padding or gel.
Also, when I go hiking or walking in warmer weather, sometimes my fingers feel heavy and swollen. They don't look funny, but they ache, too. I never get this while cycling, x country skiing, or snow shoeing. I am wondering if it is the fit of my shoes or something else that causes this soreness in my hands.

You might also check to see that none of your rings are getting caught up in your gloves.