Comparing the Effects of Design Interventions on the Quality of Design Concepts as a Reflection of Ideation Flexibility

Daniel Henderson, Kathryn Weed Jablokow, Shanna Daly, Seda McKilligan, Eli Silk, Jennifer Bracken

Research output: Contribution to journalArticle

Abstract

Many tools, techniques, and other interventions have been developed to support idea generation within the design process. In previous research, we explored the separate effects of three such design interventions: teaming, problem framing, and design heuristics. In the teaming intervention, participants discussed a design prompt together but recorded their own ideas separately. In problem framing, multiple versions (framings) of each design prompt were used to elicit different solutions. In design heuristics, participants used specially designed cards to prompt new ways of thinking about the given design problem. In the current work, we compared the effects of these three interventions on students' design ideas with respect to one idea attribute in particular-quality. In total, 1088 design concepts were collected from 171 undergraduate students in engineering and industrial design from two universities. Individual cognitive style was also assessed using Kirton's Adaption-Innovation inventory (KAI). Six metrics taken from the design literature were used to assess the quality of each concept, namely: acceptability, applicability, clarity, effectiveness, implementability, and implicational explicitness. Paired t-tests and Pearson correlations were used to assess differences in quality between concepts generated with and without the three interventions; in addition, secondary effects were sought based on the cognitive styles and academic standings of the participants. Statistically significant differences were observed in design concept quality for the teaming and design heuristics interventions over the full sample and for some subgroups separated by cognitive style and academic standing. These results have implications for how educators teach design interventions and how students choose and apply interventions to affect the quality of their own design solutions.

Original languageEnglish (US)
Article number031103
JournalJournal of Mechanical Design, Transactions of the ASME
Volume141
Issue number3
DOIs
StatePublished - Mar 1 2019

Fingerprint

Students
Product design
Innovation

All Science Journal Classification (ASJC) codes

  • Mechanics of Materials
  • Mechanical Engineering
  • Computer Science Applications
  • Computer Graphics and Computer-Aided Design

Cite this

@article{26c44810647745ab901e972b3006d17d,
title = "Comparing the Effects of Design Interventions on the Quality of Design Concepts as a Reflection of Ideation Flexibility",
abstract = "Many tools, techniques, and other interventions have been developed to support idea generation within the design process. In previous research, we explored the separate effects of three such design interventions: teaming, problem framing, and design heuristics. In the teaming intervention, participants discussed a design prompt together but recorded their own ideas separately. In problem framing, multiple versions (framings) of each design prompt were used to elicit different solutions. In design heuristics, participants used specially designed cards to prompt new ways of thinking about the given design problem. In the current work, we compared the effects of these three interventions on students' design ideas with respect to one idea attribute in particular-quality. In total, 1088 design concepts were collected from 171 undergraduate students in engineering and industrial design from two universities. Individual cognitive style was also assessed using Kirton's Adaption-Innovation inventory (KAI). Six metrics taken from the design literature were used to assess the quality of each concept, namely: acceptability, applicability, clarity, effectiveness, implementability, and implicational explicitness. Paired t-tests and Pearson correlations were used to assess differences in quality between concepts generated with and without the three interventions; in addition, secondary effects were sought based on the cognitive styles and academic standings of the participants. Statistically significant differences were observed in design concept quality for the teaming and design heuristics interventions over the full sample and for some subgroups separated by cognitive style and academic standing. These results have implications for how educators teach design interventions and how students choose and apply interventions to affect the quality of their own design solutions.",
author = "Daniel Henderson and Jablokow, {Kathryn Weed} and Shanna Daly and Seda McKilligan and Eli Silk and Jennifer Bracken",
year = "2019",
month = "3",
day = "1",
doi = "10.1115/1.4042048",
language = "English (US)",
volume = "141",
journal = "Journal of Mechanical Design - Transactions of the ASME",
issn = "1050-0472",
publisher = "ASME",
number = "3",

}

Comparing the Effects of Design Interventions on the Quality of Design Concepts as a Reflection of Ideation Flexibility. / Henderson, Daniel; Jablokow, Kathryn Weed; Daly, Shanna; McKilligan, Seda; Silk, Eli; Bracken, Jennifer.

In: Journal of Mechanical Design, Transactions of the ASME, Vol. 141, No. 3, 031103, 01.03.2019.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Comparing the Effects of Design Interventions on the Quality of Design Concepts as a Reflection of Ideation Flexibility

AU - Henderson, Daniel

AU - Jablokow, Kathryn Weed

AU - Daly, Shanna

AU - McKilligan, Seda

AU - Silk, Eli

AU - Bracken, Jennifer

PY - 2019/3/1

Y1 - 2019/3/1

N2 - Many tools, techniques, and other interventions have been developed to support idea generation within the design process. In previous research, we explored the separate effects of three such design interventions: teaming, problem framing, and design heuristics. In the teaming intervention, participants discussed a design prompt together but recorded their own ideas separately. In problem framing, multiple versions (framings) of each design prompt were used to elicit different solutions. In design heuristics, participants used specially designed cards to prompt new ways of thinking about the given design problem. In the current work, we compared the effects of these three interventions on students' design ideas with respect to one idea attribute in particular-quality. In total, 1088 design concepts were collected from 171 undergraduate students in engineering and industrial design from two universities. Individual cognitive style was also assessed using Kirton's Adaption-Innovation inventory (KAI). Six metrics taken from the design literature were used to assess the quality of each concept, namely: acceptability, applicability, clarity, effectiveness, implementability, and implicational explicitness. Paired t-tests and Pearson correlations were used to assess differences in quality between concepts generated with and without the three interventions; in addition, secondary effects were sought based on the cognitive styles and academic standings of the participants. Statistically significant differences were observed in design concept quality for the teaming and design heuristics interventions over the full sample and for some subgroups separated by cognitive style and academic standing. These results have implications for how educators teach design interventions and how students choose and apply interventions to affect the quality of their own design solutions.

AB - Many tools, techniques, and other interventions have been developed to support idea generation within the design process. In previous research, we explored the separate effects of three such design interventions: teaming, problem framing, and design heuristics. In the teaming intervention, participants discussed a design prompt together but recorded their own ideas separately. In problem framing, multiple versions (framings) of each design prompt were used to elicit different solutions. In design heuristics, participants used specially designed cards to prompt new ways of thinking about the given design problem. In the current work, we compared the effects of these three interventions on students' design ideas with respect to one idea attribute in particular-quality. In total, 1088 design concepts were collected from 171 undergraduate students in engineering and industrial design from two universities. Individual cognitive style was also assessed using Kirton's Adaption-Innovation inventory (KAI). Six metrics taken from the design literature were used to assess the quality of each concept, namely: acceptability, applicability, clarity, effectiveness, implementability, and implicational explicitness. Paired t-tests and Pearson correlations were used to assess differences in quality between concepts generated with and without the three interventions; in addition, secondary effects were sought based on the cognitive styles and academic standings of the participants. Statistically significant differences were observed in design concept quality for the teaming and design heuristics interventions over the full sample and for some subgroups separated by cognitive style and academic standing. These results have implications for how educators teach design interventions and how students choose and apply interventions to affect the quality of their own design solutions.

UR - http://www.scopus.com/inward/record.url?scp=85059884073&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85059884073&partnerID=8YFLogxK

U2 - 10.1115/1.4042048

DO - 10.1115/1.4042048

M3 - Article

VL - 141

JO - Journal of Mechanical Design - Transactions of the ASME

JF - Journal of Mechanical Design - Transactions of the ASME

SN - 1050-0472

IS - 3

M1 - 031103

ER -