Thumbs up x1
by Asterocrat » May 28th, 2015, 6:35 am
You see Shroom, the problem with your post right here is that you are comparing Level Designing Contests to a sport event, and judges to referees. By that, you are admitting that there is some sort of general guidelines, like lines on the ground and nets at both ends of the court, as how to actually judge a level. Truth is, there is not. To judge a level, there is no clear line on the ground to tell you if the level is right or is wrong for a very simple reason: It's going to sound cheesy, but it's the downright truth: You don't judge a level with your reasoning and counting how many coins there are in a level, but with your heart, with your feelings. You base your scores based on how you felt after playing level, based on the different emotions of joy, frustration or awe you encountered when playing the level, therefore a level is more comparable to a cultural piece (artwork, movie) than a sport match. Therefore, there is no way there is such a thing as a "mistake" when judging a level. Here, let me use an example that is surprising close to Level Designing Contests to illustrate.
My example is Dark Souls. For those who don't know, Dark Souls is a exploration/adventure video game that supposedly is extremely difficult, with unforgiving parts, almost unfair gameplay and extremely rare save points. Jeez, that sounds rather similar to some levels we had to judge in the past, doesn't it? Anyway, to cite an example, probably the most crucial item in the game, necessary to advance, is hidden very deep in the game and the game doesn't give you ANY clue as how to obtain it. Opinions about the game are divided into two groups: one side blames the game for its obviously frustrating gameplay, while the other side claims it to be one of the greatest games because this sense of helplessness is one of the most ingenious game design in any video game. Obviously opinions feel rather different, even complete opposites, but does that necessarily mean that one of the sides is wrong and the other one is right? No. Because everyone's opinion on the game is based on what they enjoy in a video game, their opinion on game design in general, it's how they are, it's how they feel, and because of that they can't be wrong.
Now, let's say we take a sample from everyone that can have an opinion on Dark Souls. Let's say, uh... 5 people, we'll call them judges. Four of them happen to dislike the game entirely, they all give it an average score because it plays well and have decent graphics, but it's still very frustrating. The last one just happens to love the game, because it's exactly what he expected to see in a video game, he gives it a pretty high score. Now, because we only have a smaller sample, because that one guy rated much higher than the others, does that mean he'll have to consider his thought process, question his feelings about the game, reconsider his judging? No! We (hopefully) agreed up there that his opinion was a valid opinion. It's an opinion like any other, but he just happened to be the only one who felt that way about the game in the given sample. Does that mean is opinion is NOW wrong? Still no, because that would be concerning.
What I'm trying to say is, as different as it is from the "pseudo-norm" you guys are defining, an opinion, a score, cannot be wrong because it's more based on our emotions, than on actual facts. I'm not saying that there are no rules a level should follow (for example Dark Souls is still beatable, similarly, a level should be beatable), but a difference, even a drastic one, is more than normal when judging because, as I said in another post, we are only human.
With all that in mind, I think judging should continue as it is right now; however, I think it should be a good idea that the host check the scores before posting the results. If a score is way too different from the average from the other judges (say, 5-point difference) on a specific level, then he should check the justifications for this score. If then the host is not satisfied with the justification, he could have the right (if you guys still think we need it) to ask the judge to either reconsider his judging, or give more justifications. However, as proven by the current 25quared LDC, a systematic process (with the meeting of the judges) in ALL LDCs with ALL judges is most of the times unnecessary and hard to plan (getting all judges online at the same time is pretty hard).
Just my honest and non-aggressive two cents.
Gift by Forgotten - Full size here!: show