How should we measure creativity in design studies? a comparison of social science and engineering approaches

Scarlett R. Miller, Samuel T. Hunter, Elizabeth Starkey, Sharath Ramachandran, Faez Ahmed, Mark Fuge

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Design researchers have long sought to understand the mechanisms that support creative idea development. However, one of the key challenges faced by the design community is how to effectively measure the nebulous construct of creativity. The social science and engineering communities have adopted two vastly different approaches to solving this problem, both of which have been deployed throughout engineering design research. The goal of this paper was to compare and contrast these two approaches using design ratings of nearly 1000 engineering design ideas paired with a qualitative study with expert raters. The results of this study identify that while these two methods provide similar ratings of idea quality, there was a statistically significant negative relationship between these methods for ratings of idea novelty. Qualitative analysis of recordings from expert raters' think aloud concept mapping points to potential sources of disagreement. In addition, the results show that while quasi-expert and expert raters provided similar ratings of design novelty, there was not significant agreement between these groups for ratings of design quality. The results of this study provide guidance for the deployment of idea ratings in engineering design research and evidence for the development and potential modification of engineering design creativity metrics.

Original languageEnglish (US)
Title of host publication32nd International Conference on Design Theory and Methodology (DTM)
PublisherAmerican Society of Mechanical Engineers (ASME)
ISBN (Electronic)9780791883976
StatePublished - 2020
EventASME 2020 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, IDETC-CIE 2020 - Virtual, Online
Duration: Aug 17 2020Aug 19 2020

Publication series

NameProceedings of the ASME Design Engineering Technical Conference
Volume8

Conference

ConferenceASME 2020 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, IDETC-CIE 2020
CityVirtual, Online
Period8/17/208/19/20

All Science Journal Classification (ASJC) codes

  • Mechanical Engineering
  • Computer Graphics and Computer-Aided Design
  • Computer Science Applications
  • Modeling and Simulation

Fingerprint Dive into the research topics of 'How should we measure creativity in design studies? a comparison of social science and engineering approaches'. Together they form a unique fingerprint.

Cite this