sometimes having all that extra stuff on your saddle hurts more than it helps. There is more surface space for it to rub against. It sounds counter intuitive but It really could be that you need a better fitting saddle (it sounds like you are using your own). Make sure that you aren't spinning so fast that you are bouncing, as that's a sure way to get sore down there. that's my advice.
-Rachel