I only buy men's, especially jerseys. Women's clothes are too short, too curvy (especially when the hips of the garment is nowhere near my hips), and I cannot fit my shoulders into them to save my life--think Chris Farley's fat man in a little coat--I keep thinking I'm going to split the thing in the back, no matter how huge the jersey may be elsewhere.

I wear men's XS or S typically, race cut only (Yes I have hips, but I do not have a gut). Even though our sizes are different, the rule I go by is to look at the size chart and when in doubt order down a size. I'd look at chest and waist measurements and not worry about height or weight that may be on the chart. If you don't have big shoulders like me, going a little smaller to accommodate your waist won't be that bad for your bust. Plus, race cut jerseys in particular are still pretty little in the arms and shoulders while roomy enough for broader chests on men...meaning that with your smaller ribcage, there's room left over for your boobs.

I also prefer men's bib shorts 1) because it's easy to find bibs, 2) because women's waists are too high and inseams too short, 3) some women's shorts can be too big in the butt and hips and too wide in the chamois making for an ill-fitting chamois that gets caught on the nose of my saddle when mounting/dismounting and other fun stuff, and 4) men's shorts just fit me. The only challenge is finding ones small enough, particularly in a store so I can try it on.