If your program opts to use the VIP judging mode, scoring criteria will need to be configured. These criteria are numerical scoring devices through which judges will apply scores to evaluate their assigned entries. Each scoring criterion created is directly linked to a score set and all scoring criteria associated with a score set will be added together in a total score. The total number of scoring criteria depends solely on your needs as there is no limit to the number that can be created.
To create scoring criteria follow the steps outlined below.
Configure scoring criteria
- In the Manage workspace, go to Judging > Settings > Scoring criteria
- Click New criterion
- Add a Label that will display to your judges
- Provide a Score title (maximum 32 characters), this is required
- Provide a Shortcode, this is used in summary tables and exports where space is limited— the full label may be too long and take up too much space
-
Help text and Hint text are optional but can be used to give your judges context or instructions
Help text
Appears as a hover tip with a ? icon
Hint text
Appears alongside the scoring criteria
- If you have multiple Score sets, select the one just created
- Select your desired 'Control'
- Select score
- Slider
- Keyboard input
- Recommendation--to learn more about this option see our dedicated guide: Recommendation judging
- For all controls aside from recommendation, give the scoring criteria a Maximum score
- Add a Weight value to the score--the weight is simply a multiplier that allows you to make one criteria worth more than another, even if they're scored out of the same value
Example: criterion C and D are both scored out of five points. Criterion C has a weight of 1 while criterion D has a weight of 2. If both are given a perfect five, criterion C will total 5 points and criterion D will total to 10 points.Note: you can apply a weight of 0 only if the score set calculation is set to 'Mean'. - Under the 'Commenting' heading, choose your desired option(s)
- Comment on individual scores invited will make a comment area on this criteria available to judges.
- Comment on individual scores required will make a comment on this criteria compulsory for judges.
- If desired, select the field in which you'd like the criteria to be aligned in the Align this score with a field drop-down; if no field is selected, the criteria is simply positioned at the end of the entry as shown below
Aligned with a field Not aligned with a field Important: if you align a scoring criteria with a field which doesn't apply to all categories, it will not be visible to the judges (since it does not exist in the entry). This means the entry will not be considered 'Complete' even though the judges have scored all visible criteria.Important: if you align a scoring criteria with a conditional field, it may or may not appear to your judges and you'll see the message outlined below. Should this be intentional, we recommend utilising the "Mean" calculation within your score set configuration. For more details, see: What is the difference between 'Sum' and 'Mean' result calculation?. If you do not wish for judges to see scoring criteria for fields that may not be applicable, select the Don't score when unanswered checkbox. - In the event that you choose not to align your scoring criteria with a specific field, you should provide an Order value for the scoring criteria
Note: this simply controls the placement of the scoring criteria on screen for the judge, in score matrix and in exports. It is optional but advisable to use so you have control of its sequence. - Select a Control type:
-
Select score, the default is a dropdown for choosing from the range of integer scores
-
Slider is a horizontal drag'n'drop control that is a more visual method of scoring and is in increments of one decimal place
-
Keyboard input allows judges to key in their score
-
Select score, the default is a dropdown for choosing from the range of integer scores
- Finally, chose which Categories (all, or some) this scoring criteria should be used for
- Click Save when you've finished
Important: deleting a scoring criteria and recalculating the leaderboard will permanently delete scoring data collected from your judges.
Video overview