Since your profile says Central Texas.... Try Academy. They usually have the Insport shorts for fairly cheap. I have a mens pair and they aren't anything special, but definitely better than not wearing bike shorts.
You don't have to have a jersey. You could get a moisture wicking shirt at Academy or Target for pretty cheap. It would minimize your costs and maximize your comfort.
Amanda
2011 Specialized Epic Comp 29er | Specialized Phenom | "Marie Laveau"
2007 Cannondale Synapse Carbon Road | Selle Italia Lady Gel Flow | "Miranda"
You don't have to be great to get started, but you do have to get started to be great. -Lee J. Colan