Peer grading in a MOOC: Reliability, validity, and perceived effects

Heng Luo, Anthony C. Robinson, Jae Young Park

Research output: Contribution to journalArticle

46 Citations (Scopus)

Abstract

Peer grading offers a scalable and sustainable way of providing assessment and feedback to a massive student population. However, currently there is little empirical evidence to support the credentials of peer grading as a learning assessment method in the MOOC context. To address this research need, this study examined 1,825 peer grading assignments collected from a Coursera MOOC with the purpose of investigating the reliability and validity of peer grading, as well as its perceived effects on students' MOOC learning experience. The empirical findings provide evidence that the aggregate of student graders can provide peer grading scores fairly consistent and highly similar to instructor grading scores. Student survey responses also indicate peer grading activities to be well received by a majority of MOOC students, who believe it was fair, useful, beneficial, and would recommend it to be included in future MOOC offerings. Based on the empirical results, this study concludes with a set of principles for designing and implementing peer grading activities in the MOOC context.

Original languageEnglish (US)
JournalJournal of Asynchronous Learning Network
Volume18
Issue number2
StatePublished - Jan 1 2014

Fingerprint

grading
Students
student
learning
evidence
instructor
Feedback

All Science Journal Classification (ASJC) codes

  • Education
  • Computer Networks and Communications

Cite this

@article{d58efbd4a46e4e8497a875bc4068f230,
title = "Peer grading in a MOOC: Reliability, validity, and perceived effects",
abstract = "Peer grading offers a scalable and sustainable way of providing assessment and feedback to a massive student population. However, currently there is little empirical evidence to support the credentials of peer grading as a learning assessment method in the MOOC context. To address this research need, this study examined 1,825 peer grading assignments collected from a Coursera MOOC with the purpose of investigating the reliability and validity of peer grading, as well as its perceived effects on students' MOOC learning experience. The empirical findings provide evidence that the aggregate of student graders can provide peer grading scores fairly consistent and highly similar to instructor grading scores. Student survey responses also indicate peer grading activities to be well received by a majority of MOOC students, who believe it was fair, useful, beneficial, and would recommend it to be included in future MOOC offerings. Based on the empirical results, this study concludes with a set of principles for designing and implementing peer grading activities in the MOOC context.",
author = "Heng Luo and Robinson, {Anthony C.} and Park, {Jae Young}",
year = "2014",
month = "1",
day = "1",
language = "English (US)",
volume = "18",
journal = "Online Learning Journal",
issn = "2472-5730",
publisher = "The Online Learning Consortium",
number = "2",

}

Peer grading in a MOOC : Reliability, validity, and perceived effects. / Luo, Heng; Robinson, Anthony C.; Park, Jae Young.

In: Journal of Asynchronous Learning Network, Vol. 18, No. 2, 01.01.2014.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Peer grading in a MOOC

T2 - Reliability, validity, and perceived effects

AU - Luo, Heng

AU - Robinson, Anthony C.

AU - Park, Jae Young

PY - 2014/1/1

Y1 - 2014/1/1

N2 - Peer grading offers a scalable and sustainable way of providing assessment and feedback to a massive student population. However, currently there is little empirical evidence to support the credentials of peer grading as a learning assessment method in the MOOC context. To address this research need, this study examined 1,825 peer grading assignments collected from a Coursera MOOC with the purpose of investigating the reliability and validity of peer grading, as well as its perceived effects on students' MOOC learning experience. The empirical findings provide evidence that the aggregate of student graders can provide peer grading scores fairly consistent and highly similar to instructor grading scores. Student survey responses also indicate peer grading activities to be well received by a majority of MOOC students, who believe it was fair, useful, beneficial, and would recommend it to be included in future MOOC offerings. Based on the empirical results, this study concludes with a set of principles for designing and implementing peer grading activities in the MOOC context.

AB - Peer grading offers a scalable and sustainable way of providing assessment and feedback to a massive student population. However, currently there is little empirical evidence to support the credentials of peer grading as a learning assessment method in the MOOC context. To address this research need, this study examined 1,825 peer grading assignments collected from a Coursera MOOC with the purpose of investigating the reliability and validity of peer grading, as well as its perceived effects on students' MOOC learning experience. The empirical findings provide evidence that the aggregate of student graders can provide peer grading scores fairly consistent and highly similar to instructor grading scores. Student survey responses also indicate peer grading activities to be well received by a majority of MOOC students, who believe it was fair, useful, beneficial, and would recommend it to be included in future MOOC offerings. Based on the empirical results, this study concludes with a set of principles for designing and implementing peer grading activities in the MOOC context.

UR - http://www.scopus.com/inward/record.url?scp=84905124754&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84905124754&partnerID=8YFLogxK

M3 - Article

AN - SCOPUS:84905124754

VL - 18

JO - Online Learning Journal

JF - Online Learning Journal

SN - 2472-5730

IS - 2

ER -