VIP judging configuration

Score-based evaluation in Award Force is called VIP judging. 

VIP judging allows you to configure a fully customisable scoring rubric. Each judging stage requires the following:

  • A score set 
  • Scoring criteria
  • A judging round
  • Judges
  • One or more judging panels

You can configure VIP judging manually using the steps below or use Judging fast start.

Create a VIP judging score set

A score set defines a discrete judging stage. You can run multiple score sets at the same time.

  1. In the Manage workspace, go to Judging > Settings > Score sets
  2. Click New score set
  3. In the 'Details; tab, select VIP judging under 'Judging mode'
  4. Enter a clear Score set name (visible to judges)
  5. In the 'Display' tab, select from the configurable options:
    • Layout
    • Category quick filter
    • Entry order
    • List length
    • Abstention and conflict of interest
    • Commenting options
    • Attachment display and downloads
    • Referee details
    • Image gallery display
    • Share scores from another score set
    • Slideshow options
    • Score matrix
    • Cover image
    • Field visibility
  6. Click Save

For more information on score set options, see the Configure score sets guide.

Configure scoring criteria

Scoring criteria are required for VIP judging.

Each criterion contributes to the total score for the score set. For example,

  • Criterion A — max 10 points
  • Criterion B — max 30 points
  • Maximum total — 40 points

To configure a criterion:

  1. In the Manage workspace, go to Judging > Settings > Scoring criteria
  2. Click New criterion
  3. Enter a Score title (required, max 32 characters)
  4. Enter a Shortcode
  5. Add Label, Help text, or Hint text if required
  6. Select the relevant Score set
  7. Choose a Control type
    • Select score (default dropdown)
    • Slider
    • Keyboard input
    • Recommendation
  8. Set the Maximum score
  9. Configure the Weight if required
  10. Set commenting options
  11. Align the score with an entry field if required
  12. Set the display Order (if not aligned)
  13. Select applicable Categories
  14. Click Save

For more information on scoring criteria configuration, see the Scoring criteria guide.

Set up a judging round

Judging rounds control when judges can access their assignments.

  1. In the Manage workspace, go to Judging > Settings > Rounds
  2. Click Add round
  3. Select Judging round
  4. Set the Start and End date/time
  5. Click Save

For more information on round configuration, see the Ultimate guide to rounds.

Add judges

Judges must exist as users before they can score entries.

  1. In the Manage workspace, go to Users
  2. Add or import judges

See the Adding judges guide for detailed instructions.

Create a judging panel

Panels determine which judges score which entries. You may create multiple panels per score set—for example, one per category.

  1. In the Manage workspace, go to Judging > Settings > Panels
  2. Click New panel
  3. Select the relevant Score set
  4. In the 'Entries' section, select categories, chapters, and/or tags
  5. Configure moderation and archived entry options if required
  6. In the 'Who' section, select eligible judges
  7. In the 'When' section, select the judging round
  8. Click Save

Good to know

  • The score set name is visible to judges—keep it clear and concise.
  • The visual content layout configurable in the score set ignores scoring alignment for media files.
  • The score matrix pop-up displays up to 200 entries.
  • Images larger than 16,300px square cannot display as thumbnails.
  • Weighted scores are calculated as score × weight.
  • A weight of 0 may be used when result calculation is set to Mean. If aligning criteria to conditional fields, consider using Mean calculation
  • Add yourself to panels to test configuration.
  • If setting up judging before entries exist, create test entries. Test entries can be deleted or moderation rejected to avoid affecting results.
  • Programs with more specific judge and entry pairing requirements may choose to use manual or random assignments instead.
Was this article helpful?
7 out of 11 found this helpful

Articles in this section

See more