Compact power equipment troubleshooting training: Formative assessment using think-aloud pair problem solving

Caitlin Young, Michael Pate

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Think-aloud pair problem solving (TAPPS) was used to formatively assess agriculture students' problem solving during compact power equipment troubleshooting training. A total of 56 students were taught engine operational theory and a troubleshooting procedure followed by training in TAPPS. Prior to troubleshooting a pre-test engine operation theory knowledge test was given to students. Students were then asked to troubleshoot a single cylinder overhead valve Briggs and Stratton engine which had a system fault involving insufficient valve clearance, spark plug gap clearance, or insufficient fuel delivery to the carburetor. Each student was randomly assigned to individually troubleshoot one of the three faults using either TAPPS or by working alone. To standardize the question prompts used during TAPPS, the listener role was performed by an undergraduate researcher. Only 66.1% of students were successful at identifying and repairing the fault. The chi-square test of association showed no significant difference (χ2 (1) = .08, p = .78, phi = .038) in success rate between students who worked alone and those who used TAPPS. A review of video recordings of TAPPS sessions revealed unsuccessful students stated feeling unfamiliar with valve clearance adjustment procedures, forgetting possible faults, lack of understanding compression gauge operation, and connecting engine theory of operation with troubleshooting. TAPPS served as a way for the instructor to identify student misunderstandings to inform individual instructional interventions to improve students troubleshooting skills. Suggestions for instruction included memory association exercises to help students linking engine components with possible faults.

Original languageEnglish (US)
Title of host publicationAmerican Society of Agricultural and Biological Engineers Annual International Meeting 2013, ASABE 2013
PublisherAmerican Society of Agricultural and Biological Engineers
Pages173-179
Number of pages7
ISBN (Print)9781627486651
StatePublished - Jan 1 2013
EventAmerican Society of Agricultural and Biological Engineers Annual International Meeting 2013 - Kansas City, MO, United States
Duration: Jul 21 2013Jul 24 2013

Publication series

NameAmerican Society of Agricultural and Biological Engineers Annual International Meeting 2013, ASABE 2013
Volume1

Other

OtherAmerican Society of Agricultural and Biological Engineers Annual International Meeting 2013
CountryUnited States
CityKansas City, MO
Period7/21/137/24/13

Fingerprint

students
Students
engines
valves (equipment)
Engines
Carburetors
Spark plugs
Video recording
Engine cylinders
gauges
college students
teachers
Agriculture
Gages
exercise
researchers
testing
agriculture
Data storage equipment

All Science Journal Classification (ASJC) codes

  • Agronomy and Crop Science
  • Bioengineering

Cite this

Young, C., & Pate, M. (2013). Compact power equipment troubleshooting training: Formative assessment using think-aloud pair problem solving. In American Society of Agricultural and Biological Engineers Annual International Meeting 2013, ASABE 2013 (pp. 173-179). (American Society of Agricultural and Biological Engineers Annual International Meeting 2013, ASABE 2013; Vol. 1). American Society of Agricultural and Biological Engineers.
Young, Caitlin ; Pate, Michael. / Compact power equipment troubleshooting training : Formative assessment using think-aloud pair problem solving. American Society of Agricultural and Biological Engineers Annual International Meeting 2013, ASABE 2013. American Society of Agricultural and Biological Engineers, 2013. pp. 173-179 (American Society of Agricultural and Biological Engineers Annual International Meeting 2013, ASABE 2013).
@inproceedings{6284a5b307dd4bd0a7b45c5364b48b44,
title = "Compact power equipment troubleshooting training: Formative assessment using think-aloud pair problem solving",
abstract = "Think-aloud pair problem solving (TAPPS) was used to formatively assess agriculture students' problem solving during compact power equipment troubleshooting training. A total of 56 students were taught engine operational theory and a troubleshooting procedure followed by training in TAPPS. Prior to troubleshooting a pre-test engine operation theory knowledge test was given to students. Students were then asked to troubleshoot a single cylinder overhead valve Briggs and Stratton engine which had a system fault involving insufficient valve clearance, spark plug gap clearance, or insufficient fuel delivery to the carburetor. Each student was randomly assigned to individually troubleshoot one of the three faults using either TAPPS or by working alone. To standardize the question prompts used during TAPPS, the listener role was performed by an undergraduate researcher. Only 66.1{\%} of students were successful at identifying and repairing the fault. The chi-square test of association showed no significant difference (χ2 (1) = .08, p = .78, phi = .038) in success rate between students who worked alone and those who used TAPPS. A review of video recordings of TAPPS sessions revealed unsuccessful students stated feeling unfamiliar with valve clearance adjustment procedures, forgetting possible faults, lack of understanding compression gauge operation, and connecting engine theory of operation with troubleshooting. TAPPS served as a way for the instructor to identify student misunderstandings to inform individual instructional interventions to improve students troubleshooting skills. Suggestions for instruction included memory association exercises to help students linking engine components with possible faults.",
author = "Caitlin Young and Michael Pate",
year = "2013",
month = "1",
day = "1",
language = "English (US)",
isbn = "9781627486651",
series = "American Society of Agricultural and Biological Engineers Annual International Meeting 2013, ASABE 2013",
publisher = "American Society of Agricultural and Biological Engineers",
pages = "173--179",
booktitle = "American Society of Agricultural and Biological Engineers Annual International Meeting 2013, ASABE 2013",
address = "United States",

}

Young, C & Pate, M 2013, Compact power equipment troubleshooting training: Formative assessment using think-aloud pair problem solving. in American Society of Agricultural and Biological Engineers Annual International Meeting 2013, ASABE 2013. American Society of Agricultural and Biological Engineers Annual International Meeting 2013, ASABE 2013, vol. 1, American Society of Agricultural and Biological Engineers, pp. 173-179, American Society of Agricultural and Biological Engineers Annual International Meeting 2013, Kansas City, MO, United States, 7/21/13.

Compact power equipment troubleshooting training : Formative assessment using think-aloud pair problem solving. / Young, Caitlin; Pate, Michael.

American Society of Agricultural and Biological Engineers Annual International Meeting 2013, ASABE 2013. American Society of Agricultural and Biological Engineers, 2013. p. 173-179 (American Society of Agricultural and Biological Engineers Annual International Meeting 2013, ASABE 2013; Vol. 1).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Compact power equipment troubleshooting training

T2 - Formative assessment using think-aloud pair problem solving

AU - Young, Caitlin

AU - Pate, Michael

PY - 2013/1/1

Y1 - 2013/1/1

N2 - Think-aloud pair problem solving (TAPPS) was used to formatively assess agriculture students' problem solving during compact power equipment troubleshooting training. A total of 56 students were taught engine operational theory and a troubleshooting procedure followed by training in TAPPS. Prior to troubleshooting a pre-test engine operation theory knowledge test was given to students. Students were then asked to troubleshoot a single cylinder overhead valve Briggs and Stratton engine which had a system fault involving insufficient valve clearance, spark plug gap clearance, or insufficient fuel delivery to the carburetor. Each student was randomly assigned to individually troubleshoot one of the three faults using either TAPPS or by working alone. To standardize the question prompts used during TAPPS, the listener role was performed by an undergraduate researcher. Only 66.1% of students were successful at identifying and repairing the fault. The chi-square test of association showed no significant difference (χ2 (1) = .08, p = .78, phi = .038) in success rate between students who worked alone and those who used TAPPS. A review of video recordings of TAPPS sessions revealed unsuccessful students stated feeling unfamiliar with valve clearance adjustment procedures, forgetting possible faults, lack of understanding compression gauge operation, and connecting engine theory of operation with troubleshooting. TAPPS served as a way for the instructor to identify student misunderstandings to inform individual instructional interventions to improve students troubleshooting skills. Suggestions for instruction included memory association exercises to help students linking engine components with possible faults.

AB - Think-aloud pair problem solving (TAPPS) was used to formatively assess agriculture students' problem solving during compact power equipment troubleshooting training. A total of 56 students were taught engine operational theory and a troubleshooting procedure followed by training in TAPPS. Prior to troubleshooting a pre-test engine operation theory knowledge test was given to students. Students were then asked to troubleshoot a single cylinder overhead valve Briggs and Stratton engine which had a system fault involving insufficient valve clearance, spark plug gap clearance, or insufficient fuel delivery to the carburetor. Each student was randomly assigned to individually troubleshoot one of the three faults using either TAPPS or by working alone. To standardize the question prompts used during TAPPS, the listener role was performed by an undergraduate researcher. Only 66.1% of students were successful at identifying and repairing the fault. The chi-square test of association showed no significant difference (χ2 (1) = .08, p = .78, phi = .038) in success rate between students who worked alone and those who used TAPPS. A review of video recordings of TAPPS sessions revealed unsuccessful students stated feeling unfamiliar with valve clearance adjustment procedures, forgetting possible faults, lack of understanding compression gauge operation, and connecting engine theory of operation with troubleshooting. TAPPS served as a way for the instructor to identify student misunderstandings to inform individual instructional interventions to improve students troubleshooting skills. Suggestions for instruction included memory association exercises to help students linking engine components with possible faults.

UR - http://www.scopus.com/inward/record.url?scp=84881627354&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84881627354&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:84881627354

SN - 9781627486651

T3 - American Society of Agricultural and Biological Engineers Annual International Meeting 2013, ASABE 2013

SP - 173

EP - 179

BT - American Society of Agricultural and Biological Engineers Annual International Meeting 2013, ASABE 2013

PB - American Society of Agricultural and Biological Engineers

ER -

Young C, Pate M. Compact power equipment troubleshooting training: Formative assessment using think-aloud pair problem solving. In American Society of Agricultural and Biological Engineers Annual International Meeting 2013, ASABE 2013. American Society of Agricultural and Biological Engineers. 2013. p. 173-179. (American Society of Agricultural and Biological Engineers Annual International Meeting 2013, ASABE 2013).