Request for Transparency

Level Designer Contests, discussion about and help with the Level Designer, information about glitches, and levels and level series can be found here.

Moderator: Level Moderator

Final judge discussion?

Yes
10
63%
No
6
38%
 
Total votes : 16

Re: Request for Transparency

Postby ~Yuri » May 28th, 2015, 7:20 am

Well, I'm going to say this one last time because I'm already tired of all this: If you have an opinion as a judge, and can defend it with valid reasons, then why should the discussion be a problem for you? This discussion is not really to settle scores that were not rating according to the majority, but rather to prove that your score was fair. This shouldn't only apply to the judges whose scores don't match, it should apply for all them.

This is an official competition, guys. Of course the fun you have with the level counts. But remember to rate not only on what you feel, but on what you actually see (or play in this case). Of course you can still say "This level was not really fun to play" as long as you still point out the "However, I noticed this level had this and this", and "But this level felt fresh because of its concepts", if that's the case. If you don't have fun playing a level, yet it's a noticeably good level, then you should take everything, not only your fun in consideration, or vice-versa.

Maybe your alternative with the host checking the scores and then asking the judges about the discrepancies, could be a good one too, since it'd be easier. As long as the host takes the responsibility for this from now on as well.
Image
credits to Nan for this amazing gif ^-^
other sigs: show
Image
Awesome sig made by MessengerOfDreams, way back in 2013. She's awesome <3
Image
Amazing sigbar made by FrozenFire!
Image
Image

Great sig made by Raiyuuni!

Image

Made by Konradix! ^-^ (clickable!)
User avatar
~Yuri
Boo

 
Posts: 677
Joined: December 5th, 2012, 3:09 pm
Location: lost, can you please give me some directions?

Cookie
NanTheDark: "Congrats on winning our duel. May the trees watch over you."

Thumbs Up given: 46 times
Thumbs Up received: 85 times

Re: Request for Transparency

Thumbs up x2

Postby Asterocrat » May 28th, 2015, 7:33 am

Yurimaster wrote:Well, I'm going to say this one last time because I'm already tired of all this: If you have an opinion as a judge, and can defend it with valid reasons, then why should the discussion be a problem for you? This discussion is not really to settle scores that were not rating according to the majority, but rather to prove that your score was fair. This shouldn't only apply to the judges whose scores don't match, it should apply for all them.

Except judges already give (sometimes really detailed) justifications inside their ratings exactly for that reason. A discussion after that just sounds redundant. Unless necessary for only specific cases, but not all levels and all judges in every LDC.

Yurimaster wrote:This is an official competition, guys. Of course the fun you have with the level counts. But remember to rate not only on what you feel, but on what you actually see (or play in this case). Of course you can still say "This level was not really fun to play" as long as you still point out the "However, I noticed this level had this and this", and "But this level felt fresh because of its concepts", if that's the case. If you don't have fun playing a level, yet it's a noticeably good level, then you should take everything, not only your fun in consideration, or vice-versa.

I never said you should ONLY judge based on what you feel, as I pointed out in my post, there are also rules that apply to levels. Also, to be honest, "freshness" in a level is a pretty subjective topic, it depends on the judge, how easily impressed they are, but also how many levels they play: the concept could have appeared in another level that he hadn't play. Just saying.
Image
Gift by Forgotten - Full size here!: show
Image

Image

User avatar
Asterocrat
Former Cosmic Ruler

Error contacting Twitter
 
Posts: 2244
Joined: July 1st, 2010, 2:37 am
Location: Strasbourg, Alsace, Eastern France

Runouw Votes Winner
Voted "Best Level Designer" in Runouw Votes 2014/15

Thumbs Up given: 267 times
Thumbs Up received: 309 times

Re: Request for Transparency

Postby MessengerOfDreams » May 28th, 2015, 7:35 am

If the level isn't enjoyable it's failed to carry any of its good concepts.

If we're required to have your train of thoughts we're better off having a code of how many points you're required to give each and every element of a level rather than having judges.
Image
Image

My Most Recent Works: show
I switch my signature a lot. If you wanna see some of my past ones, here you go.
Silent Conversations and a Crow's Final Song!
My latest story, and one of my personal favorites. A girl bound in silence finds the words to say to her prospective girlfriend as they visit her religious father in a dusty town on the edge of Kansas, where the crows' migration south brings forth anchored memories, the path to resolution, and a new start.

Form (25quared)
This might be like nothing you've seen before.
Updated Works! Some of my past best and current stuff: show
Writing Works!
Fanfic: Shut Up and Dance
why do I write so much about dancing you don't dance you've never danced in your entire life
lying little ♥♥♥♥ with your ♥♥♥♥ story ♥♥♥♥ you
also Diddy/Lucina <3

Fanfic: Worth a Thousand Words
Because the world needed a Samus/Dedede story
Fanfic: Ecstatic Silence
Just wanted to write and ♥♥♥♥ like this happens, you'd think I'd know better.
Fanfic: Far From the Edge
It's a dance that's been a long time coming for a brand new man and an unchanging woman, but once one takes the plunge there's no falling back up.
Original: Jealous Ghosts of the Mississippi
The story of Rachel meeting Amber after a lifetime of silence and being shunned
Original: Your Hand in Mine
One of my most personal stories about a dangerous romance. Now to be published in a college lit journal!
-------------------------
Recent LDC Work:
Level Series: Leaves From The Vine (ft Star King)
For the 29th LDC, a theme of grassland taken through the growth of our designing society. Won the 29th LDC!
--
Levels at Large:
Level Topic: Collection of MoD's Levels!
If you've ever wanted to see any level I made worth a damn, go here! From the quiet 14th LDC entrant Finis to the megasmash level series Dark, you can find links here!
"You were always a revolutionary, now there's just less of a chance of you crying in the corner." ~Ridder
User avatar
MessengerOfDreams
Moderator

Error contacting Twitter
 
Posts: 6615
Joined: August 16th, 2009, 11:31 am
Location: When I figure it out, I'll let you know.

Winter
2016 Story Contest

Thumbs Up given: 519 times
Thumbs Up received: 707 times

Re: Request for Transparency

Postby ~Yuri » May 28th, 2015, 7:55 am

MessengerOfDreams wrote:If the level isn't enjoyable it's failed to carry any of its good concepts.


It's not because you don't find it enjoyable that it doesn't have good concepts.

Star king wrote:Except judges already give (sometimes really detailed) justifications inside their ratings exactly for that reason. A discussion after that just sounds redundant. Unless necessary for only specific cases, but not all levels and all judges in every LDC.


I said in my post that your alternative where the host checks the scores and talk with the judges whose score is a bit off might be better because it is easier. And isn't it much better to have the whole discussion before the results then after everybody knows the results causing more actual conflict than it should?
Image
credits to Nan for this amazing gif ^-^
other sigs: show
Image
Awesome sig made by MessengerOfDreams, way back in 2013. She's awesome <3
Image
Amazing sigbar made by FrozenFire!
Image
Image

Great sig made by Raiyuuni!

Image

Made by Konradix! ^-^ (clickable!)
User avatar
~Yuri
Boo

 
Posts: 677
Joined: December 5th, 2012, 3:09 pm
Location: lost, can you please give me some directions?

Cookie
NanTheDark: "Congrats on winning our duel. May the trees watch over you."

Thumbs Up given: 46 times
Thumbs Up received: 85 times

Re: Request for Transparency

Postby ~MP3 Amplifier~ » May 28th, 2015, 8:00 am

Yurimaster wrote:I said in my post that your alternative where the host checks the scores and talk with the judges whose score is a bit off might be better because it is easier. And isn't it much better to have the whole discussion before the results then after everybody knows the results causing more actual conflict than it should?


This is actually what I did in the 23rd LDC and assumed that was what every host did too, up until now. That is how it should be as ultimately it's the host's responsibility to organise and fix any issues as it's their LDC.
"I treat everyone equally, depending on how much I like them." ~Me
The below image is a montage of my individual highest placing LDC creations, as a reminder to myself that level designing is a part of my life that I can't just leave behind

Image
I made this sig so credits to mee :amp smile:
User avatar
~MP3 Amplifier~
THE DARK LAMP

Error contacting Twitter
 
Posts: 4383
Joined: May 6th, 2011, 12:35 pm
Location: Maaars d(^_^)b

SM63 Level Designer Contest Winner
LDC #30: Finale/The Ultimate Battle

Thumbs Up given: 226 times
Thumbs Up received: 611 times

Re: Request for Transparency

Postby Asterocrat » May 28th, 2015, 8:04 am

Yurimaster wrote:
MessengerOfDreams wrote:If the level isn't enjoyable it's failed to carry any of its good concepts.

It's not because you don't find it enjoyable that it doesn't have good concepts.

See? This is exactly what I'm talking about. Different opinions like these are what causes different scores. It's normal, it's common.

Yurimaster wrote:And isn't it much better to have the whole discussion before the results then after everybody knows the results causing more actual conflict than it should?

I can only agree with that.
Image
Gift by Forgotten - Full size here!: show
Image

Image

User avatar
Asterocrat
Former Cosmic Ruler

Error contacting Twitter
 
Posts: 2244
Joined: July 1st, 2010, 2:37 am
Location: Strasbourg, Alsace, Eastern France

Runouw Votes Winner
Voted "Best Level Designer" in Runouw Votes 2014/15

Thumbs Up given: 267 times
Thumbs Up received: 309 times

Re: Request for Transparency

Postby MessengerOfDreams » May 28th, 2015, 8:05 am

If you make a level with a good concept but you've broken it beyond repair I cannot effectively take part in its good concepts b
Image
Image

My Most Recent Works: show
I switch my signature a lot. If you wanna see some of my past ones, here you go.
Silent Conversations and a Crow's Final Song!
My latest story, and one of my personal favorites. A girl bound in silence finds the words to say to her prospective girlfriend as they visit her religious father in a dusty town on the edge of Kansas, where the crows' migration south brings forth anchored memories, the path to resolution, and a new start.

Form (25quared)
This might be like nothing you've seen before.
Updated Works! Some of my past best and current stuff: show
Writing Works!
Fanfic: Shut Up and Dance
why do I write so much about dancing you don't dance you've never danced in your entire life
lying little ♥♥♥♥ with your ♥♥♥♥ story ♥♥♥♥ you
also Diddy/Lucina <3

Fanfic: Worth a Thousand Words
Because the world needed a Samus/Dedede story
Fanfic: Ecstatic Silence
Just wanted to write and ♥♥♥♥ like this happens, you'd think I'd know better.
Fanfic: Far From the Edge
It's a dance that's been a long time coming for a brand new man and an unchanging woman, but once one takes the plunge there's no falling back up.
Original: Jealous Ghosts of the Mississippi
The story of Rachel meeting Amber after a lifetime of silence and being shunned
Original: Your Hand in Mine
One of my most personal stories about a dangerous romance. Now to be published in a college lit journal!
-------------------------
Recent LDC Work:
Level Series: Leaves From The Vine (ft Star King)
For the 29th LDC, a theme of grassland taken through the growth of our designing society. Won the 29th LDC!
--
Levels at Large:
Level Topic: Collection of MoD's Levels!
If you've ever wanted to see any level I made worth a damn, go here! From the quiet 14th LDC entrant Finis to the megasmash level series Dark, you can find links here!
"You were always a revolutionary, now there's just less of a chance of you crying in the corner." ~Ridder
User avatar
MessengerOfDreams
Moderator

Error contacting Twitter
 
Posts: 6615
Joined: August 16th, 2009, 11:31 am
Location: When I figure it out, I'll let you know.

Winter
2016 Story Contest

Thumbs Up given: 519 times
Thumbs Up received: 707 times

Re: Request for Transparency

Postby Nwolf » May 28th, 2015, 8:12 am

host checking once wouldn't be bad, we know what happened with me and Omniquet







woof
Image

(c) MoD
User avatar
Nwolf
Beware, fluffy

 
Posts: 1072
Joined: May 27th, 2011, 10:27 am
Location: Hunting you

My Precious Memory

Thumbs Up given: 48 times
Thumbs Up received: 87 times

Re: Request for Transparency

Postby Supershroom » May 28th, 2015, 8:20 am

If concepts and difficulty are effectively broken indeed, all judges should normally recognize this. It's just the question how highly you value the thoughts the author still had behind what he has done. If a level was very hard, or even insane to play, but still was very innovative and interesting and could have been absolutely brilliant if done right, I'd still give it around 6 points at least in Gameplay. If a judge is too driven by emotion, he'll give it only 2 or 3 or such. To be objective, keep trying to differ between good and bad and don't let emotions like frustration or anger about the difficulty carry over too much to the score you give.

Host check? Well, as staff members hosts can truly be expected to be competent enough for it. But I'd still prefer a dialogue between all judges about a level with "off" scores. Pretty much I stick to what I've proposed here.
Image

Thank you, FF.

Nan's sig! From the previous Secret Santa event!: show
Rating standards: show
1 star: (0 - 5.75 in LDC) These levels need a lot of work. They're totally un-elaborated, and/or inherently flawed due to things like cutoff or enemy spam, or they're untested and there are too many bugs gameplay-wise, in short: Many many things went wrong in such a level.

2 stars: (6 - 9.75) These levels are not terrible, but poor. They're too short, lack scenery or they have errors and/or bugs but it's still barely enjoyable. Again, spend more effort and try to do better. (if it's your first level that I rate two stars, it's not bad. There's a long way you can still go)

3 stars: (10 - 12.75) These levels are about mediocre. They may be still a little bit short, the gameplay is fine but not very original and graphics are also solid, but not breath-taking. Try to keep improving!

4 stars: (13 - 15) These levels are nice, but not the best. Effort has been put into them, there can some professionality be seen in gameplay and graphics, they're a nice experience to play, but there are still things you can do to make it even better. Try to go the extra mile!

5 stars: (15.25 - 20) These are really great levels, those which, as said, I would give more than 15 in an LDC. These suffice many high requirements, and it already goes into subtleties if you want to make them better. These levels are successful all around. Bravo.

These are just general principles I try to follow when rating. Sometimes I don't leave a further comment when rating, most times I do, if you have questions about it, feel free to ask further.
Look at this!: show
My total SM63 level experience: 2803 levels.
Total coins collected in these: 306800

The WITBLO11 Tribute


A showcase of the 25 best levels of 2011, including such fantastic levels as Niveau Victorieux Galaxy, Plastic Beach, Dimension Infinity, Realm of the Heavens/Parallel Spires, and more!

My Level Collection: http://runouw.com/forums/viewtopic.php?f=25&t=47186

Other Important Links:
Last Legacy Level Designer tutorial
Eternal SM63 Medal Table
Eternal SM63 Score Table (all LDC scores available)
Top 10 Lists for LDC's (highest averages in a single judging criterion)
Runouw Votes Eternal Table
User avatar
Supershroom
Our local SM63 Spielberg

 
Posts: 1802
Joined: June 21st, 2014, 5:22 am
Location: Filmstudio for SM63. Sometimes also LL.

Runouw Votes Winner
New Years 2016: Best Level Winner (Ride Through The Mines)

Thumbs Up given: 244 times
Thumbs Up received: 126 times

Re: Request for Transparency

Thumbs up x1

Postby MessengerOfDreams » May 28th, 2015, 8:24 am

The fact of the matter is that each judge specializes in noticing different things or have different viewpoints, something this objectivity ordinance is effectively working to crush. It isn't a conspiracy theory against people based off of emotion. Even in the 25quared LDC, I've noticed I'm more big picture and willing to forgive non game breaking flaws, others believe that if a level has flawed gameplay it fails at its purpose. And some view it from a more artistic angle. Trying to force objectivity, which is essentially like I said giving a guideline of how much each level is forced to obtain in its score, turning judges into market testers, is fruitless and destructive to allowing people to form opinions about levels.
Image
Image

My Most Recent Works: show
I switch my signature a lot. If you wanna see some of my past ones, here you go.
Silent Conversations and a Crow's Final Song!
My latest story, and one of my personal favorites. A girl bound in silence finds the words to say to her prospective girlfriend as they visit her religious father in a dusty town on the edge of Kansas, where the crows' migration south brings forth anchored memories, the path to resolution, and a new start.

Form (25quared)
This might be like nothing you've seen before.
Updated Works! Some of my past best and current stuff: show
Writing Works!
Fanfic: Shut Up and Dance
why do I write so much about dancing you don't dance you've never danced in your entire life
lying little ♥♥♥♥ with your ♥♥♥♥ story ♥♥♥♥ you
also Diddy/Lucina <3

Fanfic: Worth a Thousand Words
Because the world needed a Samus/Dedede story
Fanfic: Ecstatic Silence
Just wanted to write and ♥♥♥♥ like this happens, you'd think I'd know better.
Fanfic: Far From the Edge
It's a dance that's been a long time coming for a brand new man and an unchanging woman, but once one takes the plunge there's no falling back up.
Original: Jealous Ghosts of the Mississippi
The story of Rachel meeting Amber after a lifetime of silence and being shunned
Original: Your Hand in Mine
One of my most personal stories about a dangerous romance. Now to be published in a college lit journal!
-------------------------
Recent LDC Work:
Level Series: Leaves From The Vine (ft Star King)
For the 29th LDC, a theme of grassland taken through the growth of our designing society. Won the 29th LDC!
--
Levels at Large:
Level Topic: Collection of MoD's Levels!
If you've ever wanted to see any level I made worth a damn, go here! From the quiet 14th LDC entrant Finis to the megasmash level series Dark, you can find links here!
"You were always a revolutionary, now there's just less of a chance of you crying in the corner." ~Ridder
User avatar
MessengerOfDreams
Moderator

Error contacting Twitter
 
Posts: 6615
Joined: August 16th, 2009, 11:31 am
Location: When I figure it out, I'll let you know.

Winter
2016 Story Contest

Thumbs Up given: 519 times
Thumbs Up received: 707 times

PreviousNext

Return to Super Mario 63 Level Designer