February 25, 2025 – Gradescope

26 February 2025

Gradescope, integrated with Moodle, streamlines grading, provides equitable feedback, and can help reduce bias. This demo covers rubric-based grading, AI-assisted answer grouping, and efficient handling of non-text submissions. Bring your laptop for hands-on exploration of automated, consistent grading feature.

Don Vosburg, Academic Technologist of Learning Innovation

A few short answers to questions that came up during the session:

How well does Gradescope’s AI recognize answers given the variety (quality) of handwriting?Unfortunately there is no published answer. I did find that Gradescope’s AI works best with English, followed by any language using a Latin-script alphabet, and it’s also been trained on math notations (fractions, integral signs, etc.). It will struggle with things like Japanese characters, Arabic script, etc. as it is trying to match the patterns in the images, but it’s not really trained on those as far as I interpret their system. – And again, the AI works best with short answers.

There was a question about coding languages (I think related to the similarity report and what populates the list of programming languages, and can we add more).
This is an area that I am unfamiliar with unfortunately. I can set up a meeting with Gradescope if anyone would like to discuss the programming assignments more in-depth, and to find out if we can add more programming languages.
Below a screenshot of the programming languages that do populate and that you can choose for the similarity report, and my understanding is that programming assignments and autograder can do all programming languages, similarity reports are isolated to this list).


Do bubble sheets have their version (A or B) on them to indicate different test versions?

  1. The bubble sheet template does not have A or B on it. Therefore there are two options:
    1. Ask students to write their test version (A or B) on their bubble sheet. If you do this, Gradescope will recognize the A or B, and automatically grade it to the appropriate answer key version A or B you created.
    2. If students do NOT indicate their test version (A or B) on their bubble sheet, you can manually sort them upon scanning their bubble sheets if you know who had which test.
      1. Or, you could also have Gradescope compare students’ scores against both version A and B answer keys automatically. Assuming they score much better on one over the other, you could quickly sort through them that way as well.
  2. Additionally, for each version you create (up to 5 – A, B, C, D, and E), you do need to indicate the correct responses for each answer key to match its corresponding test. Since Gradescope doesn’t know how you changed each of your test versions, it can’t pre-match answers. (I hope that made sense).