When do you say, "Enough!" and try a new saddle?

[TigerMom]

If you get to a point where you're not thinking about your butt/bits while you're riding, you're good.

Agree with wise Owlie.

If you aren't even feeling any discomfort until mile 20, your saddle is pretty good for you.