Recommendation judging is used when numerical scoring alone is not suitable.
Instead of assigning a score, judges select a label such as:
- Gold
- Silver
- Bronze
- Best in show
- Highly commended
Recommendation judging is configured using the VIP judging framework.
Step 1: create a VIP score set
Recommendation judging must use VIP judging mode.
- In the Manage workspace, go to Judging > Settings > Score sets
- Click New score set
- Select VIP judging under 'Judging mode'
- Enter a clear score set name (for example, Stage 1)
- Click Save
For detailed explanations of score set settings, see Configure score sets.
Step 2: configure recommendation criteria
Recommendation judging uses scoring criteria, but judges select a word or phrase instead of a number.
- In the Manage workspace, go to Judging > Settings > Scoring criteria
- Click New criterion
- Enter a Score title (maximum 32 characters)
- Enter a Shortcode for exports and summary tables
- Select your VIP score set
- Under 'Control', choose Recommendation
- Three default options (Gold, Silver, and Bronze) will appear. You can:
- Edit the labels and associated scores
- Add additional options using the + icon
- Reorder options by dragging
- Three default options (Gold, Silver, and Bronze) will appear. You can:
- Enter a Weight value
- Configure commenting options if required
- Optionally align the criterion with a specific entry field
- Set an Order value (if not aligned to a field)
- Select applicable categories
- Click Save
Recommendation options appear to judges similarly to standard scoring criteria as shown below.
Step 3: configure a judging round
- In the Manage workspace, go to Judging > Settings > Rounds
- Click Add round
- Select Judging round
- Set start and end dates and times
- Click Save
For more information, see the guide: Ultimate guide to rounds.
Step 4: create a judging panel
Panels determine which judges evaluate which entries.
- In the Manage workspace, go to Judging > Settings > Panels
- Click New panel
- Choose your score set
- In 'Entries', select the relevant categories, chapters, and/or tags
- In 'Who', select the judges or roles
- In 'When', select the judging round
- Click Save
Learn more about panels in the Create a judging panel guide.
Good to know
- Recommendation criteria cannot be created via Judging fast start.
- Each recommendation option must have a unique score value.
- If recommendations should not impact the overall result, set the Weight to 0.
- If aligning with a conditional field, the criterion may not always appear. In this case, consider using the Mean result calculation for the score set.
- Judges can see recommendation selections in their list view.
- The leaderboard can display counts for each recommendation option via the column selector.
- Recommendation results are not included in standard VIP results exports, but they can be added via a custom export.