Scoring criteria

If your program opts to use the VIP judging mode, scoring criteria will need to be configured. These criteria are numerical scoring devices through which judges will apply scores to evaluate their assigned entries. Each scoring criterion created is directly linked to a score set and all scoring criteria associated with a score set will be added together in a total score. The total number of scoring criteria depends solely on your needs as there is no limit to the number that can be created.

To create scoring criteria follow the steps outlined below. 

Configure scoring criteria

  1. In the Manage workspace, go to Judging > Settings > Scoring criteria
  2. Click New criterion
  3. Add a Label that will display to your judges
  4. Provide a Score title (maximum 32 characters), this is required
  5. Provide a Shortcode, this is used in summary tables and exports where space is limited— the full label may be too long and take up too much space
  6. Help text and Hint text are optional but can be used to give your judges context or instructions

    Help text

    Appears as a hover tip with a ? icon

    Help text.png

    Hint text

    Appears alongside the scoring criteria

    Hint text.png
  7. If you have multiple Score sets, select the one just created
  8. Select your desired 'Control'
    • Select score
    • Slider
    • Keyboard input 
    • Recommendation--to learn more about this option see our dedicated guide: Recommendation judging
  9. For all controls aside from recommendation, give the scoring criteria a Maximum score
  10. Add a Weight value to the score--the weight is simply a multiplier that allows you to make one criteria worth more than another, even if they're scored out of the same value
    Example: criterion C and D are both scored out of five points. Criterion C has a weight of 1 while criterion D has a weight of 2. If both are given a perfect five, criterion C will total 5 points and criterion D will total to 10 points.
    Note: you can apply a weight of 0 only if the score set calculation is set to 'Mean'.
  11. Under the 'Commenting' heading, choose your desired option(s)
    Commenting on individual scores.png
    • Comment on individual scores invited will make a comment area on this criteria available to judges.
    • Comment on individual scores required will make a comment on this criteria compulsory for judges. 
  12. If desired, select the field in which you'd like the criteria to be aligned in the Align this score with a field drop-down; if no field is selected, the criteria is simply positioned at the end of the entry as shown below
    Aligned with a field Scoring criteria aligned with a field
    Not aligned with a field Scoring criteria not aligned with a field
    Important: if you align a scoring criteria with a field which doesn't apply to all categories, it will not be visible to the judges (since it does not exist in the entry). This means the entry will not be considered 'Complete' even though the judges have scored all visible criteria.
    Important: if you align a scoring criteria with a conditional field, it may or may not appear to your judges and you'll see the message outlined below. Should this be intentional, we recommend utilising the "Mean" calculation within your score set configuration. For more details, see: What is the difference between 'Sum' and 'Mean' result calculation?. If you do not wish for judges to see scoring criteria for fields that may not be applicable, select the Don't score when unanswered checkbox.
  13. In the event that you choose not to align your scoring criteria with a specific field, you should provide an Order value for the scoring criteria
    Note: this simply controls the placement of the scoring criteria on screen for the judge, in score matrix and in exports. It is optional but advisable to use so you have control of its sequence.
  14. Select a Control type:
    • Select score, the default is a dropdown for choosing from the range of integer scores
      Select score
    • Slider is a horizontal drag'n'drop control that is a more visual method of scoring and is in increments of one decimal place
      Slider
    • Keyboard input allows judges to key in their score
      Keyboard input
  15. Finally, chose which Categories (all, or some) this scoring criteria should be used for
    Category selection for scoring criteria
  16. Click Save when you've finished
Important: deleting a scoring criteria and recalculating the leaderboard will permanently delete scoring data collected from your judges. 

Video overview

Was this article helpful?
3 out of 5 found this helpful

Articles in this section

See more