Request for Transparency

Level Designer Contests, discussion about and help with the Level Designer, information about glitches, and levels and level series can be found here.

Moderator: Level Moderator

Final judge discussion?

Yes
10
63%
No
6
38%
 
Total votes : 16

Re: Request for Transparency

Postby MessengerOfDreams » April 30th, 2015, 8:38 pm

Also, if we're gonna talk about transparency, BY, it's very clear that these posts you have consistently made here and in the QM incident, have been aimed at one person consistently, and I personally don't care for it.
Image
Image

My Most Recent Works: show
I switch my signature a lot. If you wanna see some of my past ones, here you go.
Silent Conversations and a Crow's Final Song!
My latest story, and one of my personal favorites. A girl bound in silence finds the words to say to her prospective girlfriend as they visit her religious father in a dusty town on the edge of Kansas, where the crows' migration south brings forth anchored memories, the path to resolution, and a new start.

Form (25quared)
This might be like nothing you've seen before.
Updated Works! Some of my past best and current stuff: show
Writing Works!
Fanfic: Shut Up and Dance
why do I write so much about dancing you don't dance you've never danced in your entire life
lying little ♥♥♥♥ with your ♥♥♥♥ story ♥♥♥♥ you
also Diddy/Lucina <3

Fanfic: Worth a Thousand Words
Because the world needed a Samus/Dedede story
Fanfic: Ecstatic Silence
Just wanted to write and ♥♥♥♥ like this happens, you'd think I'd know better.
Fanfic: Far From the Edge
It's a dance that's been a long time coming for a brand new man and an unchanging woman, but once one takes the plunge there's no falling back up.
Original: Jealous Ghosts of the Mississippi
The story of Rachel meeting Amber after a lifetime of silence and being shunned
Original: Your Hand in Mine
One of my most personal stories about a dangerous romance. Now to be published in a college lit journal!
-------------------------
Recent LDC Work:
Level Series: Leaves From The Vine (ft Star King)
For the 29th LDC, a theme of grassland taken through the growth of our designing society. Won the 29th LDC!
--
Levels at Large:
Level Topic: Collection of MoD's Levels!
If you've ever wanted to see any level I made worth a damn, go here! From the quiet 14th LDC entrant Finis to the megasmash level series Dark, you can find links here!
"You were always a revolutionary, now there's just less of a chance of you crying in the corner." ~Ridder
User avatar
MessengerOfDreams
Moderator

Error contacting Twitter
 
Posts: 6615
Joined: August 16th, 2009, 11:31 am
Location: When I figure it out, I'll let you know.

Winter
2016 Story Contest

Thumbs Up given: 519 times
Thumbs Up received: 707 times

Re: Request for Transparency

Postby nin10mode » April 30th, 2015, 10:46 pm

As someone largely disconnected from LDing at the moment, I don't really see a problem testing new methods.

If you don't mind longer judging periods (and I mean much longer unless we set up chats and schedule times to make sure everyone's on the same page because lord knows simply PMing each other gets messy), having a communicating judging panel is certainly feasible.

Or we could try making anonymous entry a standard if you don't mind quiet LDCs.

We could even give Shroom's system a go, though it doesn't seem to help him in this particular case.

Heck, we could try having just the host judge, because having a host entrant has always kinda bothered me.



...all that said, it's easy to pick up on imaginary things if you're actively looking for them.
Image
Art: show
Anime: show
Imagei use mal now but this sigbar is pretty
Videos: show
ImageImage
im@s: show
Image
User avatar
nin10mode
Immune to Death

Error contacting Twitter
Error contacting last.fm
 
Posts: 3087
Joined: October 3rd, 2009, 6:11 am
Location: Not here

Credit To Team

Thumbs Up given: 102 times
Thumbs Up received: 221 times

Re: Request for Transparency

Postby Supershroom » May 1st, 2015, 2:24 am

I don't see why the host shouldn't be allowed to enter. If this was stated, it would strongly restrict the circle of potential hosts.

Generally I feel like it's not the problem of the system but the problem of the people being involved into it, but exactly this is where BY's idea can help a lot. The judges shouldn't tell the exact scores, but they should tell their main concerns and reasons for deducts and their general assessments and some stats of their tables such as highest score, number of 16's / 15's and such, so they can clarify each other if a part of a level is really frustrating or not, or if there's one more trick than they believe, and if they're indeed too strict or not. I 100%ly agree on this, it's totally worth the extra waiting time.

Also every judge should make a post in the Judging Style topic. Even if the same things are repeated again and again, it helps a lot to those who wonder how to get higher scores from specific judges.
Image

Thank you, FF.

Nan's sig! From the previous Secret Santa event!: show
Rating standards: show
1 star: (0 - 5.75 in LDC) These levels need a lot of work. They're totally un-elaborated, and/or inherently flawed due to things like cutoff or enemy spam, or they're untested and there are too many bugs gameplay-wise, in short: Many many things went wrong in such a level.

2 stars: (6 - 9.75) These levels are not terrible, but poor. They're too short, lack scenery or they have errors and/or bugs but it's still barely enjoyable. Again, spend more effort and try to do better. (if it's your first level that I rate two stars, it's not bad. There's a long way you can still go)

3 stars: (10 - 12.75) These levels are about mediocre. They may be still a little bit short, the gameplay is fine but not very original and graphics are also solid, but not breath-taking. Try to keep improving!

4 stars: (13 - 15) These levels are nice, but not the best. Effort has been put into them, there can some professionality be seen in gameplay and graphics, they're a nice experience to play, but there are still things you can do to make it even better. Try to go the extra mile!

5 stars: (15.25 - 20) These are really great levels, those which, as said, I would give more than 15 in an LDC. These suffice many high requirements, and it already goes into subtleties if you want to make them better. These levels are successful all around. Bravo.

These are just general principles I try to follow when rating. Sometimes I don't leave a further comment when rating, most times I do, if you have questions about it, feel free to ask further.
Look at this!: show
My total SM63 level experience: 2803 levels.
Total coins collected in these: 306800

The WITBLO11 Tribute


A showcase of the 25 best levels of 2011, including such fantastic levels as Niveau Victorieux Galaxy, Plastic Beach, Dimension Infinity, Realm of the Heavens/Parallel Spires, and more!

My Level Collection: http://runouw.com/forums/viewtopic.php?f=25&t=47186

Other Important Links:
Last Legacy Level Designer tutorial
Eternal SM63 Medal Table
Eternal SM63 Score Table (all LDC scores available)
Top 10 Lists for LDC's (highest averages in a single judging criterion)
Runouw Votes Eternal Table
User avatar
Supershroom
Our local SM63 Spielberg

 
Posts: 1802
Joined: June 21st, 2014, 5:22 am
Location: Filmstudio for SM63. Sometimes also LL.

Runouw Votes Winner
New Years 2016: Best Level Winner (Ride Through The Mines)

Thumbs Up given: 244 times
Thumbs Up received: 126 times

Re: Request for Transparency

Postby Harmless » May 1st, 2015, 3:53 am

Supershroom wrote:Also every judge should make a post in the Judging Style topic. Even if the same things are repeated again and again, it helps a lot to those who wonder how to get higher scores from specific judges.

Even though it's in the judges's best interest to judge objectively, okay.

The best thing to do to obtain higher scores is to listen to the things that went wrong in your level, really. And, of course, keep what happens right. If anything that's what we've been doing for 29 LDC's. In fact, I don't really remember any major incidents where the judgings have been called into question. And of course I would be lying here. But let's not talk about that, okay? Point is, it's been working well, and isn't broke. Don't fix what isn't broke.
Expect something cool here soon!

~ Tesla Bromonovich
User avatar
Harmless
Is it lunch time yet?

 
Posts: 2793
Joined: June 25th, 2011, 11:53 am
Location: Mother Russia!

Runouw Votes Winner
For winning Master of a Hidden Talent in the RV Summer 2017

Thumbs Up given: 271 times
Thumbs Up received: 240 times

Re: Request for Transparency

Postby -BY » May 1st, 2015, 5:26 am

Harmless wrote:The best thing to do to obtain higher scores is to listen to the things that went wrong in your level, really. And, of course, keep what happens right. If anything that's what we've been doing for 29 LDC. In fact, I don't really remember any major incidents where the judgings have been called into question.


Problem isn't the problem that you disliked specific things, but rather if it's questionable how many points one reducts for these. And that's where talking to other judges comes in handy. Especially for people who seem to get frustrated easily and feel like turning down an entire level, often way beyond objectivity.
Image

Big thank you to FrozenFire who created this masterpiece. : )
User avatar
-BY
Honorary Member

 
Posts: 900
Joined: May 23rd, 2012, 11:43 pm
Location: 298

Razzian Fighter

Thumbs Up given: 72 times
Thumbs Up received: 100 times

Re: Request for Transparency

Postby Harmless » May 1st, 2015, 5:37 am

I would reduce tons of points for an untested, very unforgiving wing-cap speedrunning segment. Let's not forget the forced damage from badly positioned rotating platforms, a cheap bottomless pit that gave me a headache, background-tiles merging with the front-tiles and/or the background causing confusion in the level, and some red block challenges I could care less about because they're so ♥♥♥♥ glitchy.

I think you underestimate the amount of bugs and unenjoyable aspects in Shroom's level.
Expect something cool here soon!

~ Tesla Bromonovich
User avatar
Harmless
Is it lunch time yet?

 
Posts: 2793
Joined: June 25th, 2011, 11:53 am
Location: Mother Russia!

Runouw Votes Winner
For winning Master of a Hidden Talent in the RV Summer 2017

Thumbs Up given: 271 times
Thumbs Up received: 240 times

Re: Request for Transparency

Postby -BY » May 1st, 2015, 5:59 am

Harmless wrote:I would reduce tons of points for an untested, very unforgiving wing-cap speedrunning segment. Let's not forget the forced damage from badly positioned rotating platforms, a cheap bottomless pit that gave me a headache, background-tiles merging with the front-tiles and/or the background causing confusion in the level, and some red block challenges I could care less about because they're so ♥♥♥♥ glitchy.

I think you underestimate the amount of bugs and unenjoyable aspects in Shroom's level.


Thing is. I'm not dismissing the good things either. And as long as the good aspects overweight the bad ones, it's more than questionable if a level should lose that much points. Not trying to turn down mega's level now. But it did in fact only better, because it simply did nothing outstanding good, nor doing too much things bad. The judgings in the most recent LDC's kind of tell the level designer, to avoid going out of the box and keep going for the same uniform methods. It's both motivation and inspiration killing to see that happen on this scale. Also not sure why people keep thinking that I'm directing this only to you, Harmless.

MessengerOfDreams wrote:Also, if we're gonna talk about transparency, BY, it's very clear that these posts you have consistently made here and in the QM incident, have been aimed at one person consistently, and I personally don't care for it.


The QM accident was caused by one person. So why should I direct it to multiple people? I'm generally having multiple people and LDC's in mind, when adressing my issues. My main intention of this topic is to, guess what, make a positive change to the current system. I am and was not the only one, feeling that things are off with the judging system on this site. And the purpose of this topic is to solely offer a possible solution for it. In the end it's up to you guys, if you want to go for it or not. But at least, I'm actually trying to do something for it, instead of clinging to the past solely, while letting my ignorance blinding me.

You wouldn't ever hear a word about me, regarding these things, if I wouldn't actually care. I don't know what you think about me. But it's by now certainly a wrong picture. (This is also adressed to the LDC posts you directed towards me, trying to predict reactions and whatnot.)
Image

Big thank you to FrozenFire who created this masterpiece. : )
User avatar
-BY
Honorary Member

 
Posts: 900
Joined: May 23rd, 2012, 11:43 pm
Location: 298

Razzian Fighter

Thumbs Up given: 72 times
Thumbs Up received: 100 times

Re: Request for Transparency

Postby Harmless » May 1st, 2015, 8:29 am

-BY wrote:Thing is. I'm not dismissing the good things either. And as long as the good aspects overweight the bad ones, it's more than questionable if a level should lose that much points. Not trying to turn down mega's level now. But it did in fact only better, because it simply did nothing outstanding good, nor doing too much things bad. The judgings in the most recent LDC's kind of tell the level designer, to avoid going out of the box and keep going for the same uniform methods. It's both motivation and inspiration killing to see that happen on this scale. Also not sure why people keep thinking that I'm directing this only to you, Harmless.

Oh, whoops. Sorry, I wasn't under the impression that you hated my guts or anything, I was just feeling a little annoyed and rattled from the incident over the 29th LDC topic. I don't think this has anything to do with the quote museum, as this sort of topic has been in debate regarding the judging panel and system.

I would disagree that the recent judgings promoted uncreative levels - In fact, there were plenty of point reduction for being too basic with platforming, for having uncreative level design (singerboy41's level for example, though that might be too obvious), etc. Personally I felt ChaosYoshi hit it out of the park execution and conceptually wise, and a few other judges agreed conceptually wise, but apparently none of them agreed execution wise.

Which makes me feel like if we discussed CY's level and asked eachother 'is this part really forced damage/an execution error?', then maybe we could've done judgings better. But hey, live and learn I guess. As stated earlier, I do like your suggestion of having the judging the panel stay in contact with eachother.

My main intention of this topic is to, guess what, make a positive change to the current system. I am and was not the only one, feeling that things are off with the judging system on this site. And the purpose of this topic is to solely offer a possible solution for it. In the end it's up to you guys, if you want to go for it or not. But at least, I'm actually trying to do something for it, instead of clinging to the past solely, while letting my ignorance blinding me.

You wouldn't ever hear a word about me, regarding these things, if I wouldn't actually care. I don't know what you think about me. But it's by now certainly a wrong picture. (This is also adressed to the LDC posts you directed towards me, trying to predict reactions and whatnot.)

Well it wasn't bad. If it's been going on for solid years without much complaints (until now), then I feel like it's not really something that broken as we make it out to be. I'm by no doubt saying that you shouldn't care and not suggest positive changes, but we gotta make sure what you're saying makes sense, and notice if there even is a real issue in the system. :P

Because there's been constant complaints ever since the 27th LDC regarding the judging panel, maybe there is a small issue (albeit most of the complaining came from one Supershroom). I have noticed that judgings tend to get quite varied here and there - one level might have a 17.5 as well as a 9.25. So while I don't feel like we should take out the genuine opinions of the judges and how each individually feels about each level, there should be more communication between them so they can have a better grasp of the level. This can help them fix anything they've missed.

tl;dr I like your suggestion regarding communication between the judges, but as for the overall system I think it's still okay.
Expect something cool here soon!

~ Tesla Bromonovich
User avatar
Harmless
Is it lunch time yet?

 
Posts: 2793
Joined: June 25th, 2011, 11:53 am
Location: Mother Russia!

Runouw Votes Winner
For winning Master of a Hidden Talent in the RV Summer 2017

Thumbs Up given: 271 times
Thumbs Up received: 240 times

Re: Request for Transparency

Postby -BY » May 4th, 2015, 6:48 am

Poll is added. If people can agree on this I'd kind of like this to take effect in the next LDC already. After all there are no major changes to be made.
Image

Big thank you to FrozenFire who created this masterpiece. : )
User avatar
-BY
Honorary Member

 
Posts: 900
Joined: May 23rd, 2012, 11:43 pm
Location: 298

Razzian Fighter

Thumbs Up given: 72 times
Thumbs Up received: 100 times

Re: Request for Transparency

Thumbs up x1

Postby MessengerOfDreams » May 4th, 2015, 8:33 am

As long this doesn't have forced pressure to conform to the standards of others, I'll consider it.
Image
Image

My Most Recent Works: show
I switch my signature a lot. If you wanna see some of my past ones, here you go.
Silent Conversations and a Crow's Final Song!
My latest story, and one of my personal favorites. A girl bound in silence finds the words to say to her prospective girlfriend as they visit her religious father in a dusty town on the edge of Kansas, where the crows' migration south brings forth anchored memories, the path to resolution, and a new start.

Form (25quared)
This might be like nothing you've seen before.
Updated Works! Some of my past best and current stuff: show
Writing Works!
Fanfic: Shut Up and Dance
why do I write so much about dancing you don't dance you've never danced in your entire life
lying little ♥♥♥♥ with your ♥♥♥♥ story ♥♥♥♥ you
also Diddy/Lucina <3

Fanfic: Worth a Thousand Words
Because the world needed a Samus/Dedede story
Fanfic: Ecstatic Silence
Just wanted to write and ♥♥♥♥ like this happens, you'd think I'd know better.
Fanfic: Far From the Edge
It's a dance that's been a long time coming for a brand new man and an unchanging woman, but once one takes the plunge there's no falling back up.
Original: Jealous Ghosts of the Mississippi
The story of Rachel meeting Amber after a lifetime of silence and being shunned
Original: Your Hand in Mine
One of my most personal stories about a dangerous romance. Now to be published in a college lit journal!
-------------------------
Recent LDC Work:
Level Series: Leaves From The Vine (ft Star King)
For the 29th LDC, a theme of grassland taken through the growth of our designing society. Won the 29th LDC!
--
Levels at Large:
Level Topic: Collection of MoD's Levels!
If you've ever wanted to see any level I made worth a damn, go here! From the quiet 14th LDC entrant Finis to the megasmash level series Dark, you can find links here!
"You were always a revolutionary, now there's just less of a chance of you crying in the corner." ~Ridder
User avatar
MessengerOfDreams
Moderator

Error contacting Twitter
 
Posts: 6615
Joined: August 16th, 2009, 11:31 am
Location: When I figure it out, I'll let you know.

Winter
2016 Story Contest

Thumbs Up given: 519 times
Thumbs Up received: 707 times

PreviousNext

Return to Super Mario 63 Level Designer