I also think it should be the top 24 scores, but everyone knows the rules going in. It's not like they changed the rules during the event.
Personally I prefer sports where there is no judging and it's you against the clock or you against the other competitors to get to the finish line, or like archery and shooting where you are aiming at a specific target, where you shot is the score. Or even horse jumping where it's you against the clock and oh yeah don't knock down any of the bars for the jumps.