I wear something padded on all rides other than very short errands on my comfort bike. You can also get padded "liners" that just go under your normal clothes for short rides. I'd go for proper padded shorts or tights for longer rides though, with a skirt or dress over if I was feeling a bit exposed.

Congrats on the ride!