Test preparation and test quality assessment: What I wish someone had told me in the beginning

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

How does an instructor prepare a test and feel confident that it is fair, balanced and the correct length? That issue worried me as I entered the teaching profession three decades ago. After a decade of writing multiple choice questions for the Professional Engineering exam and two decades of national involvement with the ABET accreditation process, it is time to pass some of the "tricks of the trade" along to the next generation of new faculty members. As a starting point for this discussion, the assumption that course outcomes have been linked to not only Program outcomes but also ABET outcomes will be reviewed. While discussing the selection of an appropriate evaluation method, I will also discuss some of the topics that do NOT lend themselves to timed tests. Suggestions on alternative methods of evaluation for those topics will be offered. This paper will focus on how to prepare good True/False and Multiple Choice questions to test knowledge and skill. It will also present a simplified version of the method psychometricians use to evaluate the quality of these types of exam questions for both difficulty and discrimination. Since many engineering and technology questions involve calculations, a test evaluation method that works for me will be discussed. This method is a good first step to demonstrate course improvement to ABET. Since much of how we teach is driven by ABET criteria and the need for continuous quality improvement, this experience should prove valuable to new faculty who may never have prepared for an ABET visit.

Original languageEnglish (US)
Title of host publication119th ASEE Annual Conference and Exposition
PublisherAmerican Society for Engineering Education
ISBN (Print)9780878232413
StatePublished - 2012
Event119th ASEE Annual Conference and Exposition - San Antonio, TX, United States
Duration: Jun 10 2012Jun 13 2012

Other

Other119th ASEE Annual Conference and Exposition
CountryUnited States
CitySan Antonio, TX
Period6/10/126/13/12

Fingerprint

Accreditation
Teaching

All Science Journal Classification (ASJC) codes

  • Engineering(all)

Cite this

Meredith, D. B. (2012). Test preparation and test quality assessment: What I wish someone had told me in the beginning. In 119th ASEE Annual Conference and Exposition American Society for Engineering Education.
Meredith, David Bruce. / Test preparation and test quality assessment : What I wish someone had told me in the beginning. 119th ASEE Annual Conference and Exposition. American Society for Engineering Education, 2012.
@inproceedings{3250ef1ec26a44d68fd0baa704a418a6,
title = "Test preparation and test quality assessment: What I wish someone had told me in the beginning",
abstract = "How does an instructor prepare a test and feel confident that it is fair, balanced and the correct length? That issue worried me as I entered the teaching profession three decades ago. After a decade of writing multiple choice questions for the Professional Engineering exam and two decades of national involvement with the ABET accreditation process, it is time to pass some of the {"}tricks of the trade{"} along to the next generation of new faculty members. As a starting point for this discussion, the assumption that course outcomes have been linked to not only Program outcomes but also ABET outcomes will be reviewed. While discussing the selection of an appropriate evaluation method, I will also discuss some of the topics that do NOT lend themselves to timed tests. Suggestions on alternative methods of evaluation for those topics will be offered. This paper will focus on how to prepare good True/False and Multiple Choice questions to test knowledge and skill. It will also present a simplified version of the method psychometricians use to evaluate the quality of these types of exam questions for both difficulty and discrimination. Since many engineering and technology questions involve calculations, a test evaluation method that works for me will be discussed. This method is a good first step to demonstrate course improvement to ABET. Since much of how we teach is driven by ABET criteria and the need for continuous quality improvement, this experience should prove valuable to new faculty who may never have prepared for an ABET visit.",
author = "Meredith, {David Bruce}",
year = "2012",
language = "English (US)",
isbn = "9780878232413",
booktitle = "119th ASEE Annual Conference and Exposition",
publisher = "American Society for Engineering Education",
address = "United States",

}

Meredith, DB 2012, Test preparation and test quality assessment: What I wish someone had told me in the beginning. in 119th ASEE Annual Conference and Exposition. American Society for Engineering Education, 119th ASEE Annual Conference and Exposition, San Antonio, TX, United States, 6/10/12.

Test preparation and test quality assessment : What I wish someone had told me in the beginning. / Meredith, David Bruce.

119th ASEE Annual Conference and Exposition. American Society for Engineering Education, 2012.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Test preparation and test quality assessment

T2 - What I wish someone had told me in the beginning

AU - Meredith, David Bruce

PY - 2012

Y1 - 2012

N2 - How does an instructor prepare a test and feel confident that it is fair, balanced and the correct length? That issue worried me as I entered the teaching profession three decades ago. After a decade of writing multiple choice questions for the Professional Engineering exam and two decades of national involvement with the ABET accreditation process, it is time to pass some of the "tricks of the trade" along to the next generation of new faculty members. As a starting point for this discussion, the assumption that course outcomes have been linked to not only Program outcomes but also ABET outcomes will be reviewed. While discussing the selection of an appropriate evaluation method, I will also discuss some of the topics that do NOT lend themselves to timed tests. Suggestions on alternative methods of evaluation for those topics will be offered. This paper will focus on how to prepare good True/False and Multiple Choice questions to test knowledge and skill. It will also present a simplified version of the method psychometricians use to evaluate the quality of these types of exam questions for both difficulty and discrimination. Since many engineering and technology questions involve calculations, a test evaluation method that works for me will be discussed. This method is a good first step to demonstrate course improvement to ABET. Since much of how we teach is driven by ABET criteria and the need for continuous quality improvement, this experience should prove valuable to new faculty who may never have prepared for an ABET visit.

AB - How does an instructor prepare a test and feel confident that it is fair, balanced and the correct length? That issue worried me as I entered the teaching profession three decades ago. After a decade of writing multiple choice questions for the Professional Engineering exam and two decades of national involvement with the ABET accreditation process, it is time to pass some of the "tricks of the trade" along to the next generation of new faculty members. As a starting point for this discussion, the assumption that course outcomes have been linked to not only Program outcomes but also ABET outcomes will be reviewed. While discussing the selection of an appropriate evaluation method, I will also discuss some of the topics that do NOT lend themselves to timed tests. Suggestions on alternative methods of evaluation for those topics will be offered. This paper will focus on how to prepare good True/False and Multiple Choice questions to test knowledge and skill. It will also present a simplified version of the method psychometricians use to evaluate the quality of these types of exam questions for both difficulty and discrimination. Since many engineering and technology questions involve calculations, a test evaluation method that works for me will be discussed. This method is a good first step to demonstrate course improvement to ABET. Since much of how we teach is driven by ABET criteria and the need for continuous quality improvement, this experience should prove valuable to new faculty who may never have prepared for an ABET visit.

UR - http://www.scopus.com/inward/record.url?scp=85029063534&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85029063534&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:85029063534

SN - 9780878232413

BT - 119th ASEE Annual Conference and Exposition

PB - American Society for Engineering Education

ER -

Meredith DB. Test preparation and test quality assessment: What I wish someone had told me in the beginning. In 119th ASEE Annual Conference and Exposition. American Society for Engineering Education. 2012