Commons talk:Jury tools evaluation matrix

Stages of doing an eval

Hello!

Here's what I think should be the stages of doing a fairly unbiased eval:

1. Determine the criteria beforehand, and agree that these are the valid criteria on which decisions should be based
2. Fill out the matrix guided by the previously agreed upon criteria
3. At a certain point of time, decide on the outcome based on discussions that arise out of the matrix.

Given that, I'm going to blank out the current table now so we can do #1. We'll refer back to it for step #2 since it's done a lot of good work in figuring out very useful actual information about the various tools (thanks Ilya!), but let's agree on the criteria first before we go there! YuviPanda (talk) 16:49, 6 August 2016 (UTC) For examples, see https://phabricator.wikimedia.org/T106475 YuviPanda (talk) 17:35, 6 August 2016 (UTC)

I've written detailed feature list for jurors and high-level criterias for organizers --Ilya (talk) 18:11, 6 August 2016 (UTC)

Thanks Ilya! I've renamed the section 'Proposed evaluation criteria' so we can decide on which ones are actually required as a group. YuviPanda (talk) 18:40, 6 August 2016 (UTC)