VIP judging configuration

 

Judging using scores is referred to as VIP judging in Award Force. Each stage of scoring (you can have multiple if necessary) requires four things to be configured:

  1. A judging round to control access period
  2. A VIP judging score set to collate scores
  3. Scoring criteria, the various scores to be recorded
  4. One or more judging panels to assign which judges score which entries
Set up a judging round
  1. Go to Settings > Rounds
  2. Create a new round, setting the type to Judging
  3. Set start and end dates for judging period

For more detailed instructions, see Round configuration

Create a VIP judging score set

All judging stages require a score set. Score sets allow you to have multiple discrete stages of judging, even running at the same time. For example, if you have two rounds of judging, the first round might be a process of scoring to produce a short list for each category, the second round might a fresh round of judging with another score set and new scoring criteria designed to produce a winner for each category.

  1. Go to Judging > Score sets
  2. Create a new score set, setting the judging mode to VIP judging
  3. The score set name is displayed to judges and entrants in some contexts, so name the score set clearly, e.g. "First stage judging"

That's all that's necessary for a VIP judging score set.

Under the Display tab you have many other options such as:

  • Category quick filter: to enable judges to filter by a category quickly
  • Order entries: choose the order in which you want to display entries for judges
  • List length default: choose the number of entries your judges see in their judging list view. This setting makes it easier for judges who have a lot of entries view everything at once. Options include 10, 25, 50, and 100 entries per page. 
  • Abstention and Conflict of interest: allow/disallow judges to abstain from judging an entry or declaring a conflict of interest. In the latter, the program manager can choose to include their scores in the final result
  • Commenting options: choose if judges can leave a comment on the overall entry or individual scores and if the comments are mandatory. You can also select if judges should be able to see each other's comments
  • Attachment options: choose if attachments should be displayed and/or available for download
  • Share scores: Control whether you display scores from another score set to judges on this score set. See more about displaying score matrixes to judges.
  • Slideshow and Display: choose if you want to create a slideshow for all media in the entry and choose to show/hide entry and entrant name. You can also choose to include scoring boxes on the judge PDF.
Configure scoring criteria

For VIP judging only, a scoring criterion is simply a question that you pose to the judge, for them to apply a score to. Each scoring criterion created is directly linked to a score set. All scoring criteria associated with a score set will together result in a total score.

For example, criterion A is worth 10 points and criterion B is worth 30. Both criteria are associated with a score set called "Round 1 Judging", therefore the maximum possible score for Round 1 Judging is 40.

  1. Go to Judging > Scoring critera
  2. Create a New criterion
  3. Provide a Score title (maximum 32 characters), this is required
  4. Provide a Shortcode, this is used in summary tables and exports where space is limited— the full score title may be too long and take up too much space
  5. The Label, Help text and Hint text are all optional
  6. If you have multiple Score sets, select the one just created
  7. Give the scoring criteria a Maximum score, the default 10 is a good option
  8. The Weight value adjusts the contribution of this scoring criterion to the total score. The default weight of 1 makes no adjustment to the score. Weighted scores are calculated as score multiplied by weight.
  9. If the scoring criteria you're creating should be displayed alongside a specific entry field, select the entry field from the Align this score with a field, otherwise it is simply positioned at the end of the entry
  10. Provide an Order for the scoring criteria, this simply controls the placement of the scoring criteria on screen for the judge, in score matrix and in exports. It is optional but advisable to use so you have control of its sequence. 
  11. Select a Control type: Select score, the default is a dropdown for choosing from the range of integer scores; or Slider is a horizontal drag'n'drop control that is a more visual method of scoring and is in increments of one decimal place.
  12. Finally, chose which Categories (all, or some) this scoring criteria should be used for
Create judging panel(s)

Panels help you easily manage which entries go to which judges. You can configure as many panels as necessary for a given score set— you might typically have one panel per category. NB: It's highly recommended that you add yourself to any panel you create so that you can check your configuration progress. 

  1. Go to Judging > Panels
  2. Create a New panel
  3. Choose VIP judging as the judging mode, and select the score set created earlier
  4. In the Entries section, check the categories / chapters / tags for entries that are to be judged.
  5. In the Who section select who will be allowed to judge.
    If you want to allow anybody with a specific role to judge, select Any users with a role and then check the role.
  6. In the When section, check the round configured earlier, for when judging will be permitted.

Wrapping up

Once all the above is done, go to Entries > Judge entries and assuming a) the judging round is currently open; and b) you're in at least one panel with entries; you will see a list of entries assigned to you for judging.

If you're setting up judging before there are entries in the system, you can create and submit a couple of 'test' entries for each category so that you can apply scores to test entries. You can delete your test entries (or moderation 'reject' them) to remove them from any real scoring results.