Evaluation and Grading in Rumi
This document guides you through the process of viewing and analyzing student interactions, submissions, and originality within Canvas using Rumi. It covers how to access Assignment Insights, interpret analytics, and evaluate the originality of student work.
Instructors can create and submit assignments in Rumi using the Canvas "student view." This can be helpful for you to better understand the student experience and how the originality score relates to writing behaviors.
Click on the light bulb icon to open the "Assignment Insights"
The "Assignment Insights" tool provides an overview of each Rumi assignment, including student submissions, grades, and more.
Review student writing statistics
- Rumi AI Use - Indicates if the student used the integrated rumi AI tools
-
Originality Index - This metric is a 6-star scale to indicate potential AI misuse. The index is informed by the four measures to the right:
- Writing Duration - Time spent typing.
- Total Word Count - Number of words in the document.
- Pasted Words Percentage - Shows the proportion of text pasted into the document.
- Words Revised - Indicates if the student revised their work or possibly transcribed it.
Click on the "i" icon to get more information about how the Originality Index was calculated.
This section provides narrative insights into each student's originality score.
Click on a student's name to access their submitted work
Review the submitted work
The Originality and Writing Statistics are visible at the top:
- Similarity Report - Compares the student's work against publicly available text on the internet. Rumi does not compare student work to writing submitted by other students in your class or at Tufts.
- Revision History - Observe the student's writing process and identify any signs of transcription.
- Rumi Assist - This is an AI-enabled feedback tool that has not been evaluated for use at Tufts.
- The "AI" button illustrates what text was manipulated with Rumi AI tools.
- The chat bubble button toggles comments.
Highlight text to add comments
Enter the student's grade and click "Submit Grade"
Enter the student's grade on the left-hand side, ensuring that it aligns with the grading schema in Canvas. Ensure the grade you input matches the total points possible in Canvas. Incorrect entries could significantly skew the student's final grade.