How to enable evaluation from Abstract Submission Settings

If you want to assign collected abstracts to reviewers and receive their evaluations before making acceptance decisions, you first need to complete the evaluation settings.

The evaluation settings let you define criteria, add questions, set limitations, and provide guidelines to reviewers—shaping the entire evaluation process.

To set up and begin the evaluation of collected abstracts:

1. From the left-hand menu, click Abstract.

2. Under the ABSTRACT section, select Evaluation.

Adding a guideline for reviewers

Switch on ‘Guidelines for reviewers’ title,

Write your guideline in the text editor field.

Reviewers scoring format

Decide in which format you want to receive your reviewers’ evaluation results by choosing a scoring type,

Text Rating: For receiving evaluation results as ‘Accepted’, ‘Conditionally Accepted’ or ‘Rejected’,

You can allow reviewers to suggest a change in presentation type by enabling this option. 

Star Rating: For receiving evaluation results as stars between 1 and 5,

Score Rating: For receiving evaluation results as a score between 0 - 100 points.

Additional evaluation questions

If you want to add some additional questions for reviewers to take into consideration during their evaluations and use them as a further evaluation criterion, pick the given question types you want and customize the question texts as you wish.

• Single-Line Text This field allows reviewers to submit a single line of text. This basic field can be used for anything where no more than a single line of input is required.
• Multiple Choice Question The Multiple Choice Question field allows you to present one or more checkboxes that allow multiple selections.
• Single Choice Question Allows reviewers to select one option from a list. Only one option from the available choices can be selected.
• Select Dropdown The Drop Down field allows users to select one option from a list.

Peer Review Settings

Peer review settings allow you,

• Enable blind peer review: Enabling this option will let you hide reviewers' identities easily and allow them to leave anonymous comments for authors.
• Show other reviewers' scores: If you assign a paper to more than one reviewer and want to show the scores of other reviewers enable this option.
• Lock abstract evaluation system: If you lock the evaluation system, reviewers cannot see or evaluate any abstracts.
• Send evaluation reminders to all reviewers: This option will send a reminder email to the reviewer if the reviewer is inactive for 7 days.
• Enable reviewers to add comments: You can also disable this option if you don’t want reviewers to leave comments.
• Select questions to display to reviewers: You can choose specific questions from the Additional Evaluation Questions section and make their answers visible to reviewers.