It's hard to know whether that's going to make enough of a difference for you until you go out and test the bike on those road conditions you mentioned.
FWIW, I don't think it's always necessary that you test ride "lots" of bikes. If you found a bike that you like, did some research on it, read some reviews, and the bike has the components you like/want, is within your budget, then I'd get it fitted properly and then go for a test ride. If the ride is good, you WILL know I believe. Then you're done and don't necessarily have to test ride a ton of others. Sometimes having too many options is confusing. If the ride is not to your liking, then move on to another bike. That's the approach I'd take (and did take, lol).
Good luck - it's fun shopping for a bike!!
Trying to be the person my dogs think I am.