Also check out Terry's plus-size biking clothes. Her stuff is a bit pricey, but I've found it very comfortable. Having said that, I only have a couple of the older jerseys in plus sizes--never tried the plus-sized shorts. Terry also makes a cycling knicker (capri length), which is nice when you don't want to be seen in shorts--here in Florida, they're three-season wear (too hot for summer, though).
Also look for Mt. Borah clothes--they make jerseys and I think shorts too in plus sizes.

Having said that, I often just wear a t-shirt if I'm going out for a short ride--an hour or less. You can sometimes find t-shirts in wicking fabrics these days. It's nicer to have a jersey with the pockets, but there are ways to do without the pockets--tiny handlebar bag, little fanny pack, etc.

Closing thought: dress for your comfort, not the comfort of someone who may be looking and not care for what they see--that's their problem, not yours.