Peer Assessment (Workshop)

Skip to content Skip to main navigation
Teachers College, Columbia University
Printer-friendly Version
Teachers College, Columbia University Logo

Computing and Information Services (CIS)

enabling the productive use of technologies for teaching, learning, research, administration, and outreach

Peer Assessment (Workshop)

August 3, 2016 - August 3, 2016


Workshop is an interactive activity where students can view, grade, and/or assess their own and their classmates' work. As with other Moodle activities, the use of multimedia is highly encouraged. Some major features of this activity are:

  • Peer assessment and grading
  • Two separate grades for each student: 1) for submission, which is calculated as the average of the scores given by assessors, and 2) for assessment, which is calculated based on the assessor's ability to score in a similar range as other assessors.
    • For example, if I give scores that are much higher or lower than the others who are scoring the same assessment, I get penalized in my assessment score. This feature may be useful for those interested in establishing inter-rater reliability.
    • The instructor can decide what percentage of the total grade comes from each sub-grade (e.g. 90% submission & 10% assessment)
  • The instructor coordinates the rhythm of each phase (submission phase, assessment phase, grading/evaluation phase); thus, getting every participant on the same page-- no chance to get ahead or turn in late assignments.
  • Example submission and assessment practice can be made available by the instructor to the student for comparison and an "assessment run-through."
  • Assessment options:
    • Accumulative Grading - Comments and a grade are given regarding specified aspects
    • Comments - Comments are given regarding specified aspects but no grade can be given
    • Number of Errors - Comments and a yes/no assessment are given regarding specified assertions
    • Rubric - A level assessment is given regarding specified criteria

 

Create a Workshop

Step 1: Click on Turn editing on

 

Step 2: In a Topic/Weekly section, click on Add an activity or resource and choose Workshop

 

Activity - Workshop

 

Step 3. Enter a Name and a Description.

Workshop - General

 

Step 4. Decide if you want to include peer assessment, and/or self-assessment, and Instructions for assessment. Decide of you want to include Example submissions.

 

Edit workshop

 

Step 5. Decide the Grading settings and what percentage of the final grade would come from submission and assessment (see above for more detail).

 

Workshop - Grade settings

 

Step 6. Write instructions for Submission settings.

 

Edit workshop

 

Step 7. Scroll down and click Save and display.

 

Step 8. The workshop management screen reminds you of tasks you still need to complete and lets you switch phases.

To complete the tasks with x-marks, you either click on the name of the task (if enabled) or scroll down to find a button for that task.
Once the tasks for a given phase are complete, you can click on a lightbulb to switch to the next phase.

 

Workshop - Setup phase

 

Step 9. To complete the Setup phase, you will need to edit your assessment form, which varies based on the type of grading chosen.

 

Step 10. If you checked Use examples in the settings, you need to prepare an Example submission for students to practice their assessment skills

 

Step 11. During the Submission phase, students submit their assignments. Once all of the students have submitted work, you need to allocate the submissions. You may choose Manual allocation, deciding which students assess which other students:

 

Workshop - Manual allocation tab

 

Or you may choose Random allocation in which you decide parameters and Moodle assigns the assessments.

 

Workshop - Random Allocation tab

 

Step 12. Once you have allocated the submissions, click the lightbulb under Assessment phase to allow students to assess each others' work.

 

Step 13. Once all assessments have been completed, click the lightbulb under Grading evaluation phase. You may then decide how strict you want the assessment portion of the grade to be. If you select very strict, you expect near perfect alignment between the different assessors.

 

Step 14. When you have finished with the workshop, click on the lightbulb under Closed.