In this guide:
When you're ready to start grading, the grading dashboard will list all the questions of the assignment and the grading progress for each question.
Handwritten assignments support multiple graders. Using the Next Ungraded button will take you to the next submission ready to grade, skipping over any submissions in which another grader is currently on.
We do not recommend grading before the assignment's due date when resubmissions are enabled, because resubmissions will override any grading progress.
Column | Description | |||
Question | The questions of the assignment that were added in the Questions Editor. Questions are listed in sequential order. You can select the question link to view or start grading the question and its submissions. | |||
Grading method | The method chosen to grade student answers for a question. You can set and edit the grading method in the assignment settings or on the Questions page. | |||
Auto-grouping progress | The status of the automated answer grouping process for a question. During this process, similar student answers are detected and grouped together for review and grading. This only applies to questions that have the grading method set to Grade Answer Groups. | |||
Points | The total points possible for a question. You can edit the points anytime on the Questions page. | |||
Grading progress | Shows the grading progress that’s been done for a question. The progress is tracked by percentage out of 100%. | |||
Graded by | Lists any graders that have worked on grading for the question. | |||
Submissions | Use the View link to see a list of all submitted answers either from each student or from each answer group (if question has answer groups) for the question. |
Reviewing and grading answer groups
If you select the Start Grading button at the bottom right, the grading process will walk you through each question sequentially.
First, you will be asked to review your answer groups, and then you will be asked to grade them. This process will be repeated for each question where you have decided to grade by group. This guidance covers the Reviewing and Grading steps but you may need to skip around to find guidance for the exact workflow you are using to grade each question.
How you grade answers will depend on the grading method chosen at assignment setup.
The Grading Method column will tell you whether the method is a Group or not. This section of the guidance only covers grading grouped answers.
Answer Groups Summary | Description |
Total Groups | The total number of suggested Answer Groups that need to be reviewed. |
Total Answers | The total number of answers submitted to this question. |
Groups Reviewed | The amount of answer groups of the total groups that have been reviewed. |
Ungrouped Answers | The total number of answers that aren’t in an existing answer group. |
Before grading answer groups, a critical step is to review that the answers have been grouped correctly by the auto-grouping process. This process is to ensure that the same answers have been grouped together for each question. Each group should contain a collection of the exact same answer so that a group of answers can be graded at once.
Depending on the type of question the answer group belongs to, answers may or may not have been automatically grouped. Math fill-in-the-blank and Text fill-in-the-blank type answers are grouped automatically, but the Other question type requires the manual creation of answer groups. Use the links below to find the relevant guidance for your workflow.
- Reviewing answers belonging to the "Math", "Text", and "Multiple Choice" question-types
- Reviewing answers belonging to the "Other" question type
- Grading answer groups
Reviewing answers belonging to the "Math", "Text", and "Multiple Choice" question-types
On the Answer Groups page, you can see each group of answers belonging to a particular question. Each answer group will be marked with an Answers Need Review tag at the top right corner to indicate that they have yet to be reviewed.
Answers to Math question types will be automatically assigned a name, which will allow you to know at a glance what answer that group contains.
In the below screenshot, Group 1 has been automatically assigned the contents of its answer as a name: sin 𝑥.
For other types of answers, such as multiple choice or text fill-in-the-blank, answer groups will not be named. In these cases, it may be helpful to add your own group name by selecting the three-dots menu and choosing Edit Group Name.
To begin stepping through each answer group, select the Start Reviewing button at the bottom right of the page. This will take you to the first answer group, and show you all of the answers that have been placed into this group by the AI. All of the answers here should be exactly the same.
You can select the expand icon in order to view a larger version of the answer if it is difficult to see. If you’d like to move an answer to a new group, you can select the box above it and then choose Ungroup to ungroup the answer, or Move To to move it to another group.
If you ungroup answers and delete the answer group, this will only delete the group that contains all the answers; the answers within it will not be deleted. All answers will be moved into the Ungrouped Answers section and will need to be re-grouped or graded individually.
When you have confirmed that all of the answers are the same, select the Confirm All Answers button in the middle of the page. Then, select the Next Group button at the bottom right. Repeat this process for each group.
Once you have reviewed all answer groups, select the Review Ungrouped button to review any outstanding ungrouped answers. If you need to create a new answer group, select the Create Group button at the top right, and optionally name that group. Then, you can select some or all ungrouped answers and move to a new group. If there are any other answers you’d like to leave ungrouped, select the Confirm Ungrouped button.
After you have successfully reviewed and confirmed all of the answer groups, you can select the Start Grading button at the bottom to move into the grading process for your current answer group.
Reviewing answers belonging to the "Other" question type
For the Other question type, answers will be Ungrouped but you can manually group the answers by selecting Create Group from the sidebar and then adding the same answers to the Groups.
The checkboxes beside each answer will be grayed out until you create your first answer group.
Once you have created your first answer group and selected all of one type of answer, scroll to the top of the answers section and select the Move To button. Then, select the Answer Group you’d like to move them to.
You can use the Select All Answers checkbox to conveniently select all of the available answers, if every answer left belongs in the same group.
Once you have successfully reviewed and confirmed all of the answer groups, you can select the Start Grading button at the bottom to move into the grading process for your current answer group.
Grading answer groups
The grading process will take you through each group of answers one by one.
On the left side of the screen, you will see an outline around the current question. When Pan is selected, clicking and dragging the assignment will move the focus of the page. When Annotation is selected, you can click anywhere on the assignment to leave a text comment.
Any annotations you make when grading an answer group will automatically and universally apply to all student submissions in the group. For this reason, you might not want to use these tools when grading answer groups.
If you want to leave feedback or comment for just one submission in an answer group, go to the View Submissions page from the Grading Dashboard, open the student’s submission, and add your desired feedback.
On the right side of the screen is the Scoring Criteria section. This is where you can grade the question according to your scoring criteria. By default, there are two criteria: Correct and Incorrect. You can add more criteria by selecting the Add Scoring Criteria button. For example, you could create an additional Scoring Criteria named “Partial Credit” and assign half of the total points to it.
To mark a question with a criteria, select the checkbox beside the desired criterion in the side panel. The Total Points section at the top of the page will automatically update.
For more information about scoring, view our Scoring criteria and settings guidance.
To proceed to the next ungraded question, select Next Ungraded.
If another user has already begun grading the next ungraded question, a notification will appear and you will be taken to the next submission ready to grade, skipping over any submissions in which another grader is currently on.
Grading individual answers
The Grading Method column will tell you whether the method is Individual or not. This section of the guidance only covers grading individual answers.
- From the Grading Dashboard, select a question that has the grading method set to Individual. You will immediately be taken to the grading page to begin grading.
- To create a list of scoring criteria for grading:
- Select Add Scoring Criteria. Each scoring criteria will be given a number in the order they were created.
- Add the Points.
- Add a Description of the scoring criteria.
- Repeat step 2 to create as many scoring items as you need for grading the question.
- Once you have scoring items, you can select the checkbox next to the scoring criteria you want to apply to the answer. This submission is now graded and the student's score should be updated.
- Select Next to move to the next submission irrespective of whether it’s been graded.
- Select Next Ungraded to move to the next ungraded submission.
- Save Changes.
If you make any changes to a question for the type and grading method the following applies:
- Unconfirmed groups will be deleted for that question in the course of re-processing.
- Confirmed groups will remain intact.
- Any previously graded submissions for a question will retain their grade.
Any ungraded or newly uploaded submissions will be graded with the newly applied question type and grading method.