Overhaul of SM63 judging system

[Oranjui]

I doubt she meant removing personal bias, since that's obviously going to be present no matter what. I think it's more biases in the scores themselves, skewed toward certain numbers due to the presence of Other.



Something nobody's mentioned so far is that we could just adopt the scoring scheme used for LL LDCs, 25/20/5 (a 5:4:1 split between fun, graphics, and other), which places the emphasis on the key aspects of the level (main two categories), places marginally higher emphasis on gameplay to placate you guys who insist that it's objectively more important, still gives atmosphere a significant focus, has a small catch-all category for anything else which isn't so small that it doesn't make a difference but also isn't so big that it leads to major bias in the scores, and uses nice round numbers for every category, with an overall maximum of 50. We could even scale that down to 20 overall by multiplying everything by 2/5 (after the fact, though, since otherwise judings would be 10/8/2, which is even less pretty than 12/8 or 15/10). And if you want, we can keep the new "Atmosphere" name instead of Graphics.

Honestly I hadn't thought about doing this at all until I reread the OP just now and noticed Shroom's mention of it at the top of the post. But it seems like it could potentially be a better option than the current 10/5/5 (2:1:1) system or the proposed 2-category system, whether 12/8 (3:2) or 10/10 (1:1), taking aspects of both systems while maintaining a balance and allowing room for extras. Best of both worlds? Though there's still the issue of re-scaling past LDCs, but that's an issue with any sort of change to judging standards.

What do you guys think?

[MessengerOfDreams]

That'd basically create an entire new system that would render every past judging obsolete... Which would not be fun to process. Having to rescore every entrant out of 25 would destroy my calculator.

[Supershroom]

That (in other words, the shift to 50 points at LL was smoothly possible because no previous statistic works), and also otherwise I clearly say no to anything in the way of 10/8/2. The major difference between SM63 and LL is that LL offers way more possibilities on graphics - scaling items, colouring items, creating all kinds of blocks / planets, Set Post Filter etc. It makes an even bigger part of the design, hence it's reasonable that Graphics has 40% at LL. A 10/8/2 would obviously diminuish Other a lot, but the tenor of BY and a few others was that Other never made sense for SM63 at all. And if you intend to transfer plot/music/etc. points into the 8 points of a 10/8/2 system instead, you technically don't have any difference to 12/8 except for still having a little bit of clumsy additive stuff.

[MessengerOfDreams]

Still not gonna take the 12/8 split. If I need to I'll show you how many LDCs would change and how it would be biased against certain types of levels when LDC winners lose a massive amount of uniqueness.

[Supershroom]

So, although the poll still lasts 2 days, the decision on a 2-category system is clear. There hasn't been any further commenting on OJ's idea, though. Is there still more discussion necessary or can we just get to the (probably) final poll of 12/8 vs. 10/10?

[nin10mode]

Just so you know guys, regardless of the results, we're still going to consider things and have the final say ourselves as the actual hosts of official LDCs.

Which means we may take some ideas and tweak others.


This thread has gotten heated, so I'd suggest restarting discussion here.