Human validation of computer vs human generated design sketches

Christian Lopez, Scarlett Rae Miller, Conrad S. Tucker

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The objective of this work is to explore the perceived visual and functional characteristics of computer generated sketches, compared to human created sketches. In addition, this work explores the possible biases that humans may have towards the perceived functionality of computer generated sketches. Recent advancements in deep generative design methods have allowed designers to implement computational tools to automatically generate large pools of new design ideas. However, if computational tools are to co-create ideas and solutions alongside designers, their ability to generate not only novel but also functional ideas, needs to be explored. Moreover, since decision-makers need to select those creative ideas for further development to ensure innovation, their possible biases towards computer generated ideas need to be explored. In this study, 619 human participants were recruited to analyze the perceived visual and functional characteristics of 50 human created 2D sketches, and 50 2D sketches generated by a deep learning generative model (i.e., computer generated). The results indicate that participants perceived the computer generated sketches as more functional than the human generated sketches. This perceived functionality was not biased by the presence of labels that explicitly presented the sketches as either human or computer generated. Moreover, the results reveal that participants were not able to classify the 2D sketches as human or computer generated with accuracies greater than random chance. The results provide evidence that supports the capabilities of deep learning generative design tools and their potential to assist designers in creative tasks such as ideation.

Original languageEnglish (US)
Title of host publication30th International Conference on Design Theory and Methodology
PublisherAmerican Society of Mechanical Engineers (ASME)
ISBN (Electronic)9780791851845
DOIs
StatePublished - Jan 1 2018
EventASME 2018 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, IDETC/CIE 2018 - Quebec City, Canada
Duration: Aug 26 2018Aug 29 2018

Publication series

NameProceedings of the ASME Design Engineering Technical Conference
Volume7

Other

OtherASME 2018 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, IDETC/CIE 2018
CountryCanada
CityQuebec City
Period8/26/188/29/18

Fingerprint

Generative Models
Human
Design
Design Method
Biased
Labels
Innovation
Classify
Learning
Vision
Deep learning
Evidence

All Science Journal Classification (ASJC) codes

  • Mechanical Engineering
  • Computer Graphics and Computer-Aided Design
  • Computer Science Applications
  • Modeling and Simulation

Cite this

Lopez, C., Miller, S. R., & Tucker, C. S. (2018). Human validation of computer vs human generated design sketches. In 30th International Conference on Design Theory and Methodology (Proceedings of the ASME Design Engineering Technical Conference; Vol. 7). American Society of Mechanical Engineers (ASME). https://doi.org/10.1115/DETC2018-85698
Lopez, Christian ; Miller, Scarlett Rae ; Tucker, Conrad S. / Human validation of computer vs human generated design sketches. 30th International Conference on Design Theory and Methodology. American Society of Mechanical Engineers (ASME), 2018. (Proceedings of the ASME Design Engineering Technical Conference).
@inproceedings{722ecda029074c138580bfa4369e05c1,
title = "Human validation of computer vs human generated design sketches",
abstract = "The objective of this work is to explore the perceived visual and functional characteristics of computer generated sketches, compared to human created sketches. In addition, this work explores the possible biases that humans may have towards the perceived functionality of computer generated sketches. Recent advancements in deep generative design methods have allowed designers to implement computational tools to automatically generate large pools of new design ideas. However, if computational tools are to co-create ideas and solutions alongside designers, their ability to generate not only novel but also functional ideas, needs to be explored. Moreover, since decision-makers need to select those creative ideas for further development to ensure innovation, their possible biases towards computer generated ideas need to be explored. In this study, 619 human participants were recruited to analyze the perceived visual and functional characteristics of 50 human created 2D sketches, and 50 2D sketches generated by a deep learning generative model (i.e., computer generated). The results indicate that participants perceived the computer generated sketches as more functional than the human generated sketches. This perceived functionality was not biased by the presence of labels that explicitly presented the sketches as either human or computer generated. Moreover, the results reveal that participants were not able to classify the 2D sketches as human or computer generated with accuracies greater than random chance. The results provide evidence that supports the capabilities of deep learning generative design tools and their potential to assist designers in creative tasks such as ideation.",
author = "Christian Lopez and Miller, {Scarlett Rae} and Tucker, {Conrad S.}",
year = "2018",
month = "1",
day = "1",
doi = "10.1115/DETC2018-85698",
language = "English (US)",
series = "Proceedings of the ASME Design Engineering Technical Conference",
publisher = "American Society of Mechanical Engineers (ASME)",
booktitle = "30th International Conference on Design Theory and Methodology",

}

Lopez, C, Miller, SR & Tucker, CS 2018, Human validation of computer vs human generated design sketches. in 30th International Conference on Design Theory and Methodology. Proceedings of the ASME Design Engineering Technical Conference, vol. 7, American Society of Mechanical Engineers (ASME), ASME 2018 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, IDETC/CIE 2018, Quebec City, Canada, 8/26/18. https://doi.org/10.1115/DETC2018-85698

Human validation of computer vs human generated design sketches. / Lopez, Christian; Miller, Scarlett Rae; Tucker, Conrad S.

30th International Conference on Design Theory and Methodology. American Society of Mechanical Engineers (ASME), 2018. (Proceedings of the ASME Design Engineering Technical Conference; Vol. 7).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Human validation of computer vs human generated design sketches

AU - Lopez, Christian

AU - Miller, Scarlett Rae

AU - Tucker, Conrad S.

PY - 2018/1/1

Y1 - 2018/1/1

N2 - The objective of this work is to explore the perceived visual and functional characteristics of computer generated sketches, compared to human created sketches. In addition, this work explores the possible biases that humans may have towards the perceived functionality of computer generated sketches. Recent advancements in deep generative design methods have allowed designers to implement computational tools to automatically generate large pools of new design ideas. However, if computational tools are to co-create ideas and solutions alongside designers, their ability to generate not only novel but also functional ideas, needs to be explored. Moreover, since decision-makers need to select those creative ideas for further development to ensure innovation, their possible biases towards computer generated ideas need to be explored. In this study, 619 human participants were recruited to analyze the perceived visual and functional characteristics of 50 human created 2D sketches, and 50 2D sketches generated by a deep learning generative model (i.e., computer generated). The results indicate that participants perceived the computer generated sketches as more functional than the human generated sketches. This perceived functionality was not biased by the presence of labels that explicitly presented the sketches as either human or computer generated. Moreover, the results reveal that participants were not able to classify the 2D sketches as human or computer generated with accuracies greater than random chance. The results provide evidence that supports the capabilities of deep learning generative design tools and their potential to assist designers in creative tasks such as ideation.

AB - The objective of this work is to explore the perceived visual and functional characteristics of computer generated sketches, compared to human created sketches. In addition, this work explores the possible biases that humans may have towards the perceived functionality of computer generated sketches. Recent advancements in deep generative design methods have allowed designers to implement computational tools to automatically generate large pools of new design ideas. However, if computational tools are to co-create ideas and solutions alongside designers, their ability to generate not only novel but also functional ideas, needs to be explored. Moreover, since decision-makers need to select those creative ideas for further development to ensure innovation, their possible biases towards computer generated ideas need to be explored. In this study, 619 human participants were recruited to analyze the perceived visual and functional characteristics of 50 human created 2D sketches, and 50 2D sketches generated by a deep learning generative model (i.e., computer generated). The results indicate that participants perceived the computer generated sketches as more functional than the human generated sketches. This perceived functionality was not biased by the presence of labels that explicitly presented the sketches as either human or computer generated. Moreover, the results reveal that participants were not able to classify the 2D sketches as human or computer generated with accuracies greater than random chance. The results provide evidence that supports the capabilities of deep learning generative design tools and their potential to assist designers in creative tasks such as ideation.

UR - http://www.scopus.com/inward/record.url?scp=85056822934&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85056822934&partnerID=8YFLogxK

U2 - 10.1115/DETC2018-85698

DO - 10.1115/DETC2018-85698

M3 - Conference contribution

AN - SCOPUS:85056822934

T3 - Proceedings of the ASME Design Engineering Technical Conference

BT - 30th International Conference on Design Theory and Methodology

PB - American Society of Mechanical Engineers (ASME)

ER -

Lopez C, Miller SR, Tucker CS. Human validation of computer vs human generated design sketches. In 30th International Conference on Design Theory and Methodology. American Society of Mechanical Engineers (ASME). 2018. (Proceedings of the ASME Design Engineering Technical Conference). https://doi.org/10.1115/DETC2018-85698