The development of a rubric to evaluate and promote students' integration of stakeholder considerations into the engineering design process

Alexandra Emelina Coso, Amy Pritchett

Research output: Contribution to conferencePaper

2 Citations (Scopus)

Abstract

Approaches exist for assessing student performance in some activities during the design of complex systems such as aircraft. However, resources are limited for assessing students' abilities to consider design from a broad perspective and to account for a design's impact on its stakeholders. The purpose of this paper is to introduce a rubric to assess how students perceive and integrate stakeholders into the design of a complex system. Following a description of the rubric and its development, this paper describes results from the initial application and evaluation of the rubric by a panel of faculty, graduate students, and research scientists, as they used the rubric to assess aircraft design projects. This initial evaluation demonstrated the strengths of the rubric (particularly with regards to validity) and how the reliability of the ratings among raters was sensitive to the few, discrete scores that the initial version of the rubric allowed; potential improvements to improve reliability are noted. The paper concludes with discussion of how the rubric can be used by design instructors as both a formative assessment tool to identify and describe to students key aspects of the design process necessary to account for stakeholder considerations, and as a summative assessment tool.

Original languageEnglish (US)
StatePublished - Jan 1 2014
Event121st ASEE Annual Conference and Exposition: 360 Degrees of Engineering Education - Indianapolis, IN, United States
Duration: Jun 15 2014Jun 18 2014

Other

Other121st ASEE Annual Conference and Exposition: 360 Degrees of Engineering Education
CountryUnited States
CityIndianapolis, IN
Period6/15/146/18/14

Fingerprint

Students
Large scale systems
Aircraft

All Science Journal Classification (ASJC) codes

  • Engineering(all)

Cite this

Coso, A. E., & Pritchett, A. (2014). The development of a rubric to evaluate and promote students' integration of stakeholder considerations into the engineering design process. Paper presented at 121st ASEE Annual Conference and Exposition: 360 Degrees of Engineering Education, Indianapolis, IN, United States.
Coso, Alexandra Emelina ; Pritchett, Amy. / The development of a rubric to evaluate and promote students' integration of stakeholder considerations into the engineering design process. Paper presented at 121st ASEE Annual Conference and Exposition: 360 Degrees of Engineering Education, Indianapolis, IN, United States.
@conference{56d1e0780ffa4e5f891793e1243f97d2,
title = "The development of a rubric to evaluate and promote students' integration of stakeholder considerations into the engineering design process",
abstract = "Approaches exist for assessing student performance in some activities during the design of complex systems such as aircraft. However, resources are limited for assessing students' abilities to consider design from a broad perspective and to account for a design's impact on its stakeholders. The purpose of this paper is to introduce a rubric to assess how students perceive and integrate stakeholders into the design of a complex system. Following a description of the rubric and its development, this paper describes results from the initial application and evaluation of the rubric by a panel of faculty, graduate students, and research scientists, as they used the rubric to assess aircraft design projects. This initial evaluation demonstrated the strengths of the rubric (particularly with regards to validity) and how the reliability of the ratings among raters was sensitive to the few, discrete scores that the initial version of the rubric allowed; potential improvements to improve reliability are noted. The paper concludes with discussion of how the rubric can be used by design instructors as both a formative assessment tool to identify and describe to students key aspects of the design process necessary to account for stakeholder considerations, and as a summative assessment tool.",
author = "Coso, {Alexandra Emelina} and Amy Pritchett",
year = "2014",
month = "1",
day = "1",
language = "English (US)",
note = "121st ASEE Annual Conference and Exposition: 360 Degrees of Engineering Education ; Conference date: 15-06-2014 Through 18-06-2014",

}

Coso, AE & Pritchett, A 2014, 'The development of a rubric to evaluate and promote students' integration of stakeholder considerations into the engineering design process' Paper presented at 121st ASEE Annual Conference and Exposition: 360 Degrees of Engineering Education, Indianapolis, IN, United States, 6/15/14 - 6/18/14, .

The development of a rubric to evaluate and promote students' integration of stakeholder considerations into the engineering design process. / Coso, Alexandra Emelina; Pritchett, Amy.

2014. Paper presented at 121st ASEE Annual Conference and Exposition: 360 Degrees of Engineering Education, Indianapolis, IN, United States.

Research output: Contribution to conferencePaper

TY - CONF

T1 - The development of a rubric to evaluate and promote students' integration of stakeholder considerations into the engineering design process

AU - Coso, Alexandra Emelina

AU - Pritchett, Amy

PY - 2014/1/1

Y1 - 2014/1/1

N2 - Approaches exist for assessing student performance in some activities during the design of complex systems such as aircraft. However, resources are limited for assessing students' abilities to consider design from a broad perspective and to account for a design's impact on its stakeholders. The purpose of this paper is to introduce a rubric to assess how students perceive and integrate stakeholders into the design of a complex system. Following a description of the rubric and its development, this paper describes results from the initial application and evaluation of the rubric by a panel of faculty, graduate students, and research scientists, as they used the rubric to assess aircraft design projects. This initial evaluation demonstrated the strengths of the rubric (particularly with regards to validity) and how the reliability of the ratings among raters was sensitive to the few, discrete scores that the initial version of the rubric allowed; potential improvements to improve reliability are noted. The paper concludes with discussion of how the rubric can be used by design instructors as both a formative assessment tool to identify and describe to students key aspects of the design process necessary to account for stakeholder considerations, and as a summative assessment tool.

AB - Approaches exist for assessing student performance in some activities during the design of complex systems such as aircraft. However, resources are limited for assessing students' abilities to consider design from a broad perspective and to account for a design's impact on its stakeholders. The purpose of this paper is to introduce a rubric to assess how students perceive and integrate stakeholders into the design of a complex system. Following a description of the rubric and its development, this paper describes results from the initial application and evaluation of the rubric by a panel of faculty, graduate students, and research scientists, as they used the rubric to assess aircraft design projects. This initial evaluation demonstrated the strengths of the rubric (particularly with regards to validity) and how the reliability of the ratings among raters was sensitive to the few, discrete scores that the initial version of the rubric allowed; potential improvements to improve reliability are noted. The paper concludes with discussion of how the rubric can be used by design instructors as both a formative assessment tool to identify and describe to students key aspects of the design process necessary to account for stakeholder considerations, and as a summative assessment tool.

UR - http://www.scopus.com/inward/record.url?scp=84905197643&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84905197643&partnerID=8YFLogxK

M3 - Paper

AN - SCOPUS:84905197643

ER -

Coso AE, Pritchett A. The development of a rubric to evaluate and promote students' integration of stakeholder considerations into the engineering design process. 2014. Paper presented at 121st ASEE Annual Conference and Exposition: 360 Degrees of Engineering Education, Indianapolis, IN, United States.