Comparison of partial credit and mastery assessment on student learning and retention

Shraddha C. Sangelkar, William Lasher, Russell L. Warley, Adam Scott Hollinger

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

For several years, the faculty in the Mechanical Engineering program at Behrend have been using a modified mastery grading system in three sophomore-level courses: Statics, Strength of Materials, and Thermodynamics. In this system students are given up to three opportunities to solve each problem correctly. A solution must be essentially correct (minor errors only) in order for points to be awarded, otherwise a retake is required on a similar problem with the points awarded for a correct solution reduced with each retake. Although the effectiveness of this system has been evaluated qualitatively through student and faculty opinion, there has been no performance-based evaluation of the difference in student learning between the mastery system and the traditional partial credit system. This paper describes the results of a comparative study conducted during the spring 2015 semester on four sections of Strength of Materials (SOM). Students in each section (117 total students) of the SOM class were divided into a "mastery" group or a "partial credit" group such that there was no statistical difference between the GPA's of the two groups. Both groups took the same five initial exams during the semester, with the mastery group exams graded as described above and the partial credit group exams graded using a partial credit system. The partial credit group was not able to retake any of the exams. All students took a common final exam, which was graded on a partial credit basis, and the results of the two groups were compared. The final exam consisted of ten concept questions, five fundamentals problems, and three typical exam problems with all problems graded using partial credit. The results of this study showed that there was no significant difference in the total exam score between the two groups, nor was there a difference on the concept questions, fundamentals problems, and the first two typical exam problems. The students in the mastery group did perform better on the third typical exam problem (p-value 0.03). Based on these results it appears that mastery grading does not improve student comprehension of fundamental concepts, but that repeated practice does make them better able to solve specific problems. Sixty-two of these students were enrolled in a course for the fall 2015 semester which requires SOM as a prerequisite. The students were fortuitously evenly distributed as to GPA and the exam method from the previous course. During the first week of the fall semester, a prerequisite quiz consisting of the concept questions and fundamentals problems from the spring SOM final was administered, and the results from the two groups were compared. Based on this study, there is not enough evidence to indicate that student recall of material is impacted by the grading system.

Original languageEnglish (US)
Title of host publicationFIE 2017 - Frontiers in Education, Conference Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1-6
Number of pages6
ISBN (Electronic)9781509059195
DOIs
StatePublished - Dec 12 2017
Event47th IEEE Frontiers in Education Conference, FIE 2017 - Indianapolis, United States
Duration: Oct 18 2017Oct 21 2017

Publication series

NameProceedings - Frontiers in Education Conference, FIE
Volume2017-October
ISSN (Print)1539-4565

Other

Other47th IEEE Frontiers in Education Conference, FIE 2017
CountryUnited States
CityIndianapolis
Period10/18/1710/21/17

Fingerprint

credit
Students
learning
Strength of materials
Group
student
semester
grading
credit system
mechanical engineering
quiz
Mechanical engineering
comprehension
Thermodynamics
evaluation

All Science Journal Classification (ASJC) codes

  • Software
  • Education
  • Computer Science Applications

Cite this

Sangelkar, S. C., Lasher, W., Warley, R. L., & Hollinger, A. S. (2017). Comparison of partial credit and mastery assessment on student learning and retention. In FIE 2017 - Frontiers in Education, Conference Proceedings (pp. 1-6). (Proceedings - Frontiers in Education Conference, FIE; Vol. 2017-October). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/FIE.2017.8190603
Sangelkar, Shraddha C. ; Lasher, William ; Warley, Russell L. ; Hollinger, Adam Scott. / Comparison of partial credit and mastery assessment on student learning and retention. FIE 2017 - Frontiers in Education, Conference Proceedings. Institute of Electrical and Electronics Engineers Inc., 2017. pp. 1-6 (Proceedings - Frontiers in Education Conference, FIE).
@inproceedings{f8556a83384549178778f99a7982948e,
title = "Comparison of partial credit and mastery assessment on student learning and retention",
abstract = "For several years, the faculty in the Mechanical Engineering program at Behrend have been using a modified mastery grading system in three sophomore-level courses: Statics, Strength of Materials, and Thermodynamics. In this system students are given up to three opportunities to solve each problem correctly. A solution must be essentially correct (minor errors only) in order for points to be awarded, otherwise a retake is required on a similar problem with the points awarded for a correct solution reduced with each retake. Although the effectiveness of this system has been evaluated qualitatively through student and faculty opinion, there has been no performance-based evaluation of the difference in student learning between the mastery system and the traditional partial credit system. This paper describes the results of a comparative study conducted during the spring 2015 semester on four sections of Strength of Materials (SOM). Students in each section (117 total students) of the SOM class were divided into a {"}mastery{"} group or a {"}partial credit{"} group such that there was no statistical difference between the GPA's of the two groups. Both groups took the same five initial exams during the semester, with the mastery group exams graded as described above and the partial credit group exams graded using a partial credit system. The partial credit group was not able to retake any of the exams. All students took a common final exam, which was graded on a partial credit basis, and the results of the two groups were compared. The final exam consisted of ten concept questions, five fundamentals problems, and three typical exam problems with all problems graded using partial credit. The results of this study showed that there was no significant difference in the total exam score between the two groups, nor was there a difference on the concept questions, fundamentals problems, and the first two typical exam problems. The students in the mastery group did perform better on the third typical exam problem (p-value 0.03). Based on these results it appears that mastery grading does not improve student comprehension of fundamental concepts, but that repeated practice does make them better able to solve specific problems. Sixty-two of these students were enrolled in a course for the fall 2015 semester which requires SOM as a prerequisite. The students were fortuitously evenly distributed as to GPA and the exam method from the previous course. During the first week of the fall semester, a prerequisite quiz consisting of the concept questions and fundamentals problems from the spring SOM final was administered, and the results from the two groups were compared. Based on this study, there is not enough evidence to indicate that student recall of material is impacted by the grading system.",
author = "Sangelkar, {Shraddha C.} and William Lasher and Warley, {Russell L.} and Hollinger, {Adam Scott}",
year = "2017",
month = "12",
day = "12",
doi = "10.1109/FIE.2017.8190603",
language = "English (US)",
series = "Proceedings - Frontiers in Education Conference, FIE",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "1--6",
booktitle = "FIE 2017 - Frontiers in Education, Conference Proceedings",
address = "United States",

}

Sangelkar, SC, Lasher, W, Warley, RL & Hollinger, AS 2017, Comparison of partial credit and mastery assessment on student learning and retention. in FIE 2017 - Frontiers in Education, Conference Proceedings. Proceedings - Frontiers in Education Conference, FIE, vol. 2017-October, Institute of Electrical and Electronics Engineers Inc., pp. 1-6, 47th IEEE Frontiers in Education Conference, FIE 2017, Indianapolis, United States, 10/18/17. https://doi.org/10.1109/FIE.2017.8190603

Comparison of partial credit and mastery assessment on student learning and retention. / Sangelkar, Shraddha C.; Lasher, William; Warley, Russell L.; Hollinger, Adam Scott.

FIE 2017 - Frontiers in Education, Conference Proceedings. Institute of Electrical and Electronics Engineers Inc., 2017. p. 1-6 (Proceedings - Frontiers in Education Conference, FIE; Vol. 2017-October).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Comparison of partial credit and mastery assessment on student learning and retention

AU - Sangelkar, Shraddha C.

AU - Lasher, William

AU - Warley, Russell L.

AU - Hollinger, Adam Scott

PY - 2017/12/12

Y1 - 2017/12/12

N2 - For several years, the faculty in the Mechanical Engineering program at Behrend have been using a modified mastery grading system in three sophomore-level courses: Statics, Strength of Materials, and Thermodynamics. In this system students are given up to three opportunities to solve each problem correctly. A solution must be essentially correct (minor errors only) in order for points to be awarded, otherwise a retake is required on a similar problem with the points awarded for a correct solution reduced with each retake. Although the effectiveness of this system has been evaluated qualitatively through student and faculty opinion, there has been no performance-based evaluation of the difference in student learning between the mastery system and the traditional partial credit system. This paper describes the results of a comparative study conducted during the spring 2015 semester on four sections of Strength of Materials (SOM). Students in each section (117 total students) of the SOM class were divided into a "mastery" group or a "partial credit" group such that there was no statistical difference between the GPA's of the two groups. Both groups took the same five initial exams during the semester, with the mastery group exams graded as described above and the partial credit group exams graded using a partial credit system. The partial credit group was not able to retake any of the exams. All students took a common final exam, which was graded on a partial credit basis, and the results of the two groups were compared. The final exam consisted of ten concept questions, five fundamentals problems, and three typical exam problems with all problems graded using partial credit. The results of this study showed that there was no significant difference in the total exam score between the two groups, nor was there a difference on the concept questions, fundamentals problems, and the first two typical exam problems. The students in the mastery group did perform better on the third typical exam problem (p-value 0.03). Based on these results it appears that mastery grading does not improve student comprehension of fundamental concepts, but that repeated practice does make them better able to solve specific problems. Sixty-two of these students were enrolled in a course for the fall 2015 semester which requires SOM as a prerequisite. The students were fortuitously evenly distributed as to GPA and the exam method from the previous course. During the first week of the fall semester, a prerequisite quiz consisting of the concept questions and fundamentals problems from the spring SOM final was administered, and the results from the two groups were compared. Based on this study, there is not enough evidence to indicate that student recall of material is impacted by the grading system.

AB - For several years, the faculty in the Mechanical Engineering program at Behrend have been using a modified mastery grading system in three sophomore-level courses: Statics, Strength of Materials, and Thermodynamics. In this system students are given up to three opportunities to solve each problem correctly. A solution must be essentially correct (minor errors only) in order for points to be awarded, otherwise a retake is required on a similar problem with the points awarded for a correct solution reduced with each retake. Although the effectiveness of this system has been evaluated qualitatively through student and faculty opinion, there has been no performance-based evaluation of the difference in student learning between the mastery system and the traditional partial credit system. This paper describes the results of a comparative study conducted during the spring 2015 semester on four sections of Strength of Materials (SOM). Students in each section (117 total students) of the SOM class were divided into a "mastery" group or a "partial credit" group such that there was no statistical difference between the GPA's of the two groups. Both groups took the same five initial exams during the semester, with the mastery group exams graded as described above and the partial credit group exams graded using a partial credit system. The partial credit group was not able to retake any of the exams. All students took a common final exam, which was graded on a partial credit basis, and the results of the two groups were compared. The final exam consisted of ten concept questions, five fundamentals problems, and three typical exam problems with all problems graded using partial credit. The results of this study showed that there was no significant difference in the total exam score between the two groups, nor was there a difference on the concept questions, fundamentals problems, and the first two typical exam problems. The students in the mastery group did perform better on the third typical exam problem (p-value 0.03). Based on these results it appears that mastery grading does not improve student comprehension of fundamental concepts, but that repeated practice does make them better able to solve specific problems. Sixty-two of these students were enrolled in a course for the fall 2015 semester which requires SOM as a prerequisite. The students were fortuitously evenly distributed as to GPA and the exam method from the previous course. During the first week of the fall semester, a prerequisite quiz consisting of the concept questions and fundamentals problems from the spring SOM final was administered, and the results from the two groups were compared. Based on this study, there is not enough evidence to indicate that student recall of material is impacted by the grading system.

UR - http://www.scopus.com/inward/record.url?scp=85043281692&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85043281692&partnerID=8YFLogxK

U2 - 10.1109/FIE.2017.8190603

DO - 10.1109/FIE.2017.8190603

M3 - Conference contribution

T3 - Proceedings - Frontiers in Education Conference, FIE

SP - 1

EP - 6

BT - FIE 2017 - Frontiers in Education, Conference Proceedings

PB - Institute of Electrical and Electronics Engineers Inc.

ER -

Sangelkar SC, Lasher W, Warley RL, Hollinger AS. Comparison of partial credit and mastery assessment on student learning and retention. In FIE 2017 - Frontiers in Education, Conference Proceedings. Institute of Electrical and Electronics Engineers Inc. 2017. p. 1-6. (Proceedings - Frontiers in Education Conference, FIE). https://doi.org/10.1109/FIE.2017.8190603