WCoD Judging Information.
Feb 1, 2020 21:57:54 GMT -5
DoubtfulObelisk, catcherman22, and 7 more like this
Post by reebdoog on Feb 1, 2020 21:57:54 GMT -5
Well well well! We reached the publish date and wonder of wonders we have a full field! Huzzah!
Now the work begins for the panel of judges that will sort this all out and believe me it will be a chore.
As they start their hours of plays and pages of notes I wanted to share with you the instructions and judging sheets they have been provided so that we are as transparent as possible. As a participant I have stayed out of any judge conversations and really only provided direction to the judging coordinator early on in the process so that there was a common vision for how this all breaks down.
Unlike other contests the WCoD is handled using head to head match-ups instead of a simple Best score wins kind of thing. That being said there still needs to be some actual point scoring system to assist in making some of the hard choices. One thing to take note of... just because a course may have a higher overall score than another does NOT mean it will win a head to head match-up. If that were the case this would all be a lot easier and shorter. The scoring is designed to assist rather than be the determining factor.
Here is a screenshot of the scoring sheet that the judges will be using. I will point out a few things below:
You'll notice an area to take notes on each hole should the judge feel the need to do so. The space you see is not limiting so the notes may be rather copious or quite short. It all depends on the judge. You will also find 5 different categories used to determine an overall score. The little triangles in the corner of those fields lead to a note that I left describing each of those categories. You'll find those notes in another screenshot in a few moments. Below that section is a scoring reference. While helpful it's really not set in stone and a judge can use whatever scoring tier they want. Maybe a 30 is friggin awesome in their mind...that's fine as long as they are consistent in their scoring as it's not a matter of adding judge scores together to find averages and means or anything like that. I couldn't fit everything in one screenshot so below all that you'll find some Head to Head consideration questions. Here's where things get a little more fun. These questions also are not here to determine a winner but instead to help judges as they compare and contrast the courses. The real winner of these match-ups needs to be done well technically of course...but it also has to be fun and really do better than it's opponent in some significant way. These questions will help direct that thinking.
Ok, this next screenshot is a page that was designed specifically for the judges to provide notes to the designers. Instead of trying to copy and paste or sort through a bunch of notes this will put everything in a one spot that can then be shared with the designer more easily. I've divided these notes up into the 5 scored categories and provided the description of each category as it appears in those little triangle notes in the judging sheet.
Now, I don't expect everyone to love everything in here. If you all do...then yay us. If not...well at least it should still make sense to you as a designer. There is one notes field you can't see and that is found at the very top of the categories. That note reads "When judging this contest please do not start at 50 and subtract points. I want you to start at ZERO and then start adding. The overall scores are not relevant out of 50 as the match-ups are head to head...be a bit brutal.
" I wanted to make sure you knew what that was as well.
The last instructions I gave were "Start at zero and earn it all. Be harsh if there are tech problems (not simply a matter of taste though). Flow, continuity, and fun are really important. I almost made the points one third technical and two thirds flow and fun...but I think folks can separate scores from choosing a winner. The three clarifying match up questions at the bottom should help". That was the text I sent to the judging coordinator before I washed my hands of it all.
What do you say? Give it a read. I think that the categories and descriptions are quite helpful and that our judges are aware of the fact these are match-ups and not simply a race for the most points.
I, for one am looking forwards to getting my butt handed to me by a few idiots...er I mean judges. HA! See you as results pop out!
Now the work begins for the panel of judges that will sort this all out and believe me it will be a chore.
As they start their hours of plays and pages of notes I wanted to share with you the instructions and judging sheets they have been provided so that we are as transparent as possible. As a participant I have stayed out of any judge conversations and really only provided direction to the judging coordinator early on in the process so that there was a common vision for how this all breaks down.
Unlike other contests the WCoD is handled using head to head match-ups instead of a simple Best score wins kind of thing. That being said there still needs to be some actual point scoring system to assist in making some of the hard choices. One thing to take note of... just because a course may have a higher overall score than another does NOT mean it will win a head to head match-up. If that were the case this would all be a lot easier and shorter. The scoring is designed to assist rather than be the determining factor.
Here is a screenshot of the scoring sheet that the judges will be using. I will point out a few things below:
You'll notice an area to take notes on each hole should the judge feel the need to do so. The space you see is not limiting so the notes may be rather copious or quite short. It all depends on the judge. You will also find 5 different categories used to determine an overall score. The little triangles in the corner of those fields lead to a note that I left describing each of those categories. You'll find those notes in another screenshot in a few moments. Below that section is a scoring reference. While helpful it's really not set in stone and a judge can use whatever scoring tier they want. Maybe a 30 is friggin awesome in their mind...that's fine as long as they are consistent in their scoring as it's not a matter of adding judge scores together to find averages and means or anything like that. I couldn't fit everything in one screenshot so below all that you'll find some Head to Head consideration questions. Here's where things get a little more fun. These questions also are not here to determine a winner but instead to help judges as they compare and contrast the courses. The real winner of these match-ups needs to be done well technically of course...but it also has to be fun and really do better than it's opponent in some significant way. These questions will help direct that thinking.
Ok, this next screenshot is a page that was designed specifically for the judges to provide notes to the designers. Instead of trying to copy and paste or sort through a bunch of notes this will put everything in a one spot that can then be shared with the designer more easily. I've divided these notes up into the 5 scored categories and provided the description of each category as it appears in those little triangle notes in the judging sheet.
Now, I don't expect everyone to love everything in here. If you all do...then yay us. If not...well at least it should still make sense to you as a designer. There is one notes field you can't see and that is found at the very top of the categories. That note reads "When judging this contest please do not start at 50 and subtract points. I want you to start at ZERO and then start adding. The overall scores are not relevant out of 50 as the match-ups are head to head...be a bit brutal.
" I wanted to make sure you knew what that was as well.
The last instructions I gave were "Start at zero and earn it all. Be harsh if there are tech problems (not simply a matter of taste though). Flow, continuity, and fun are really important. I almost made the points one third technical and two thirds flow and fun...but I think folks can separate scores from choosing a winner. The three clarifying match up questions at the bottom should help". That was the text I sent to the judging coordinator before I washed my hands of it all.
What do you say? Give it a read. I think that the categories and descriptions are quite helpful and that our judges are aware of the fact these are match-ups and not simply a race for the most points.
I, for one am looking forwards to getting my butt handed to me by a few idiots...er I mean judges. HA! See you as results pop out!
but yup, other than that this is what we're using!
