Behaviorally anchored rating scales for teamwork peer assessment

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

In team projects, peer evaluations are frequently used to evaluate students' teamwork skills and their individual contributions to project outcomes. Unfortunately, peer evaluations are usually time consuming to conduct due to the large amount of data collected. In order to efficiently assess teamwork skills of students through peer and self-evaluations, we created a web-based tool called Peer Evaluation and Assessment Resource (PEAR). Using the PEAR, instructors are able to see where students need to improve their teamwork skills and give individual feedback. We have used the system in several classes and been able to gain valuable information to help instructors improve their classes. However, we have also identified several problems such as very high peer and self ratings inconsistent with students' expected skill levels. We redesigned a peer assessment instrument from the literature based on behaviorally anchored rating scores in order to address some of these problems. This new instrument has been tested in the PEAR system, and in this paper, the results are compared to the ones obtained using a continuum scale version of the instrument.

Original languageEnglish (US)
Title of host publicationISEC 2016 - Proceedings of the 6th IEEE Integrated STEM Education Conference
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages168-172
Number of pages5
ISBN (Electronic)9781467397735
DOIs
StatePublished - Apr 20 2016
Event6th IEEE Integrated STEM Education Conference, ISEC 2016 - Princeton, United States
Duration: Mar 5 2016 → …

Publication series

NameISEC 2016 - Proceedings of the 6th IEEE Integrated STEM Education Conference

Other

Other6th IEEE Integrated STEM Education Conference, ISEC 2016
CountryUnited States
CityPrinceton
Period3/5/16 → …

Fingerprint

Team Work
teamwork
rating scale
Students
Evaluation
evaluation
Resources
instructor
student
rating
resources
Information Gain
Feedback
Inconsistent
Web-based
Continuum
Skills
Evaluate

All Science Journal Classification (ASJC) codes

  • Engineering (miscellaneous)
  • Mathematics (miscellaneous)
  • Education
  • Computer Science Applications

Cite this

Konak, A., Magluilo, S., & Kulturel-Konak, S. (2016). Behaviorally anchored rating scales for teamwork peer assessment. In ISEC 2016 - Proceedings of the 6th IEEE Integrated STEM Education Conference (pp. 168-172). [7457525] (ISEC 2016 - Proceedings of the 6th IEEE Integrated STEM Education Conference). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ISECon.2016.7457525
Konak, Abdullah ; Magluilo, Steven ; Kulturel-Konak, Sadan. / Behaviorally anchored rating scales for teamwork peer assessment. ISEC 2016 - Proceedings of the 6th IEEE Integrated STEM Education Conference. Institute of Electrical and Electronics Engineers Inc., 2016. pp. 168-172 (ISEC 2016 - Proceedings of the 6th IEEE Integrated STEM Education Conference).
@inproceedings{5414f1fae3b24c52a9ed4304174ebe09,
title = "Behaviorally anchored rating scales for teamwork peer assessment",
abstract = "In team projects, peer evaluations are frequently used to evaluate students' teamwork skills and their individual contributions to project outcomes. Unfortunately, peer evaluations are usually time consuming to conduct due to the large amount of data collected. In order to efficiently assess teamwork skills of students through peer and self-evaluations, we created a web-based tool called Peer Evaluation and Assessment Resource (PEAR). Using the PEAR, instructors are able to see where students need to improve their teamwork skills and give individual feedback. We have used the system in several classes and been able to gain valuable information to help instructors improve their classes. However, we have also identified several problems such as very high peer and self ratings inconsistent with students' expected skill levels. We redesigned a peer assessment instrument from the literature based on behaviorally anchored rating scores in order to address some of these problems. This new instrument has been tested in the PEAR system, and in this paper, the results are compared to the ones obtained using a continuum scale version of the instrument.",
author = "Abdullah Konak and Steven Magluilo and Sadan Kulturel-Konak",
year = "2016",
month = "4",
day = "20",
doi = "10.1109/ISECon.2016.7457525",
language = "English (US)",
series = "ISEC 2016 - Proceedings of the 6th IEEE Integrated STEM Education Conference",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "168--172",
booktitle = "ISEC 2016 - Proceedings of the 6th IEEE Integrated STEM Education Conference",
address = "United States",

}

Konak, A, Magluilo, S & Kulturel-Konak, S 2016, Behaviorally anchored rating scales for teamwork peer assessment. in ISEC 2016 - Proceedings of the 6th IEEE Integrated STEM Education Conference., 7457525, ISEC 2016 - Proceedings of the 6th IEEE Integrated STEM Education Conference, Institute of Electrical and Electronics Engineers Inc., pp. 168-172, 6th IEEE Integrated STEM Education Conference, ISEC 2016, Princeton, United States, 3/5/16. https://doi.org/10.1109/ISECon.2016.7457525

Behaviorally anchored rating scales for teamwork peer assessment. / Konak, Abdullah; Magluilo, Steven; Kulturel-Konak, Sadan.

ISEC 2016 - Proceedings of the 6th IEEE Integrated STEM Education Conference. Institute of Electrical and Electronics Engineers Inc., 2016. p. 168-172 7457525 (ISEC 2016 - Proceedings of the 6th IEEE Integrated STEM Education Conference).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Behaviorally anchored rating scales for teamwork peer assessment

AU - Konak, Abdullah

AU - Magluilo, Steven

AU - Kulturel-Konak, Sadan

PY - 2016/4/20

Y1 - 2016/4/20

N2 - In team projects, peer evaluations are frequently used to evaluate students' teamwork skills and their individual contributions to project outcomes. Unfortunately, peer evaluations are usually time consuming to conduct due to the large amount of data collected. In order to efficiently assess teamwork skills of students through peer and self-evaluations, we created a web-based tool called Peer Evaluation and Assessment Resource (PEAR). Using the PEAR, instructors are able to see where students need to improve their teamwork skills and give individual feedback. We have used the system in several classes and been able to gain valuable information to help instructors improve their classes. However, we have also identified several problems such as very high peer and self ratings inconsistent with students' expected skill levels. We redesigned a peer assessment instrument from the literature based on behaviorally anchored rating scores in order to address some of these problems. This new instrument has been tested in the PEAR system, and in this paper, the results are compared to the ones obtained using a continuum scale version of the instrument.

AB - In team projects, peer evaluations are frequently used to evaluate students' teamwork skills and their individual contributions to project outcomes. Unfortunately, peer evaluations are usually time consuming to conduct due to the large amount of data collected. In order to efficiently assess teamwork skills of students through peer and self-evaluations, we created a web-based tool called Peer Evaluation and Assessment Resource (PEAR). Using the PEAR, instructors are able to see where students need to improve their teamwork skills and give individual feedback. We have used the system in several classes and been able to gain valuable information to help instructors improve their classes. However, we have also identified several problems such as very high peer and self ratings inconsistent with students' expected skill levels. We redesigned a peer assessment instrument from the literature based on behaviorally anchored rating scores in order to address some of these problems. This new instrument has been tested in the PEAR system, and in this paper, the results are compared to the ones obtained using a continuum scale version of the instrument.

UR - http://www.scopus.com/inward/record.url?scp=84969964483&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84969964483&partnerID=8YFLogxK

U2 - 10.1109/ISECon.2016.7457525

DO - 10.1109/ISECon.2016.7457525

M3 - Conference contribution

AN - SCOPUS:84969964483

T3 - ISEC 2016 - Proceedings of the 6th IEEE Integrated STEM Education Conference

SP - 168

EP - 172

BT - ISEC 2016 - Proceedings of the 6th IEEE Integrated STEM Education Conference

PB - Institute of Electrical and Electronics Engineers Inc.

ER -

Konak A, Magluilo S, Kulturel-Konak S. Behaviorally anchored rating scales for teamwork peer assessment. In ISEC 2016 - Proceedings of the 6th IEEE Integrated STEM Education Conference. Institute of Electrical and Electronics Engineers Inc. 2016. p. 168-172. 7457525. (ISEC 2016 - Proceedings of the 6th IEEE Integrated STEM Education Conference). https://doi.org/10.1109/ISECon.2016.7457525