Automatic facial feature extraction for predicting designers' comfort with engineering equipment during prototype creation

Shruthi Bezawada, Qianyu Hu, Allison Gray, Timothy Brick, Conrad Tucker

Research output: Contribution to journalArticle

7 Citations (Scopus)

Abstract

Designers frequently utilize engineering equipment to create physical prototypes during the iterative concept generation and prototyping phases of design. Currently, evaluating designers' efficiency during prototype creation is a manual process that either involves observational or survey based approaches. Real-time feedback when using engineering equipment has the potential to enhance designers' efficiency or mitigate potential injuries that may result from incorrect use of equipment. Toward an automated approach to addressing these challenges, the authors of this work test the hypotheses that (i) there exists a difference in designers' comfort levels before and after they use a piece of engineering prototyping equipment and (ii) a machine learning model predicts the level of comfort a designer has while using engineering prototyping equipment with accuracies greater than random chance. It has been shown that the level of comfort that an individual has while completing a task impacts their performance. The authors investigate whether automatic tracking of designers' facial expressions during prototype creation predicts their level of comfort. A study, involving 37 participants using various engineering equipment, is used to validate the approach. The support vector machine (SVM) regression model yielded a range of R squared values from 0.82 to 0.86 for an equipment-specific model. A general model built to predict comfort level across all engineering equipment yielded an R squared value of 0.68. This work has the potential to transform the manner in which design teams utilize engineering equipment toward more efficient concept generation and prototype creation processes.

Original languageEnglish (US)
Article number2593214
JournalJournal of Mechanical Design, Transactions of the ASME
Volume139
Issue number2
DOIs
StatePublished - Feb 1 2017

Fingerprint

Feature extraction
Support vector machines
Learning systems
Feedback

All Science Journal Classification (ASJC) codes

  • Mechanics of Materials
  • Mechanical Engineering
  • Computer Science Applications
  • Computer Graphics and Computer-Aided Design

Cite this

@article{1fa472e5f5c449d4956d4f0dd217b1f1,
title = "Automatic facial feature extraction for predicting designers' comfort with engineering equipment during prototype creation",
abstract = "Designers frequently utilize engineering equipment to create physical prototypes during the iterative concept generation and prototyping phases of design. Currently, evaluating designers' efficiency during prototype creation is a manual process that either involves observational or survey based approaches. Real-time feedback when using engineering equipment has the potential to enhance designers' efficiency or mitigate potential injuries that may result from incorrect use of equipment. Toward an automated approach to addressing these challenges, the authors of this work test the hypotheses that (i) there exists a difference in designers' comfort levels before and after they use a piece of engineering prototyping equipment and (ii) a machine learning model predicts the level of comfort a designer has while using engineering prototyping equipment with accuracies greater than random chance. It has been shown that the level of comfort that an individual has while completing a task impacts their performance. The authors investigate whether automatic tracking of designers' facial expressions during prototype creation predicts their level of comfort. A study, involving 37 participants using various engineering equipment, is used to validate the approach. The support vector machine (SVM) regression model yielded a range of R squared values from 0.82 to 0.86 for an equipment-specific model. A general model built to predict comfort level across all engineering equipment yielded an R squared value of 0.68. This work has the potential to transform the manner in which design teams utilize engineering equipment toward more efficient concept generation and prototype creation processes.",
author = "Shruthi Bezawada and Qianyu Hu and Allison Gray and Timothy Brick and Conrad Tucker",
year = "2017",
month = "2",
day = "1",
doi = "10.1115/1.4035428",
language = "English (US)",
volume = "139",
journal = "Journal of Mechanical Design - Transactions of the ASME",
issn = "1050-0472",
publisher = "ASME",
number = "2",

}

Automatic facial feature extraction for predicting designers' comfort with engineering equipment during prototype creation. / Bezawada, Shruthi; Hu, Qianyu; Gray, Allison; Brick, Timothy; Tucker, Conrad.

In: Journal of Mechanical Design, Transactions of the ASME, Vol. 139, No. 2, 2593214, 01.02.2017.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Automatic facial feature extraction for predicting designers' comfort with engineering equipment during prototype creation

AU - Bezawada, Shruthi

AU - Hu, Qianyu

AU - Gray, Allison

AU - Brick, Timothy

AU - Tucker, Conrad

PY - 2017/2/1

Y1 - 2017/2/1

N2 - Designers frequently utilize engineering equipment to create physical prototypes during the iterative concept generation and prototyping phases of design. Currently, evaluating designers' efficiency during prototype creation is a manual process that either involves observational or survey based approaches. Real-time feedback when using engineering equipment has the potential to enhance designers' efficiency or mitigate potential injuries that may result from incorrect use of equipment. Toward an automated approach to addressing these challenges, the authors of this work test the hypotheses that (i) there exists a difference in designers' comfort levels before and after they use a piece of engineering prototyping equipment and (ii) a machine learning model predicts the level of comfort a designer has while using engineering prototyping equipment with accuracies greater than random chance. It has been shown that the level of comfort that an individual has while completing a task impacts their performance. The authors investigate whether automatic tracking of designers' facial expressions during prototype creation predicts their level of comfort. A study, involving 37 participants using various engineering equipment, is used to validate the approach. The support vector machine (SVM) regression model yielded a range of R squared values from 0.82 to 0.86 for an equipment-specific model. A general model built to predict comfort level across all engineering equipment yielded an R squared value of 0.68. This work has the potential to transform the manner in which design teams utilize engineering equipment toward more efficient concept generation and prototype creation processes.

AB - Designers frequently utilize engineering equipment to create physical prototypes during the iterative concept generation and prototyping phases of design. Currently, evaluating designers' efficiency during prototype creation is a manual process that either involves observational or survey based approaches. Real-time feedback when using engineering equipment has the potential to enhance designers' efficiency or mitigate potential injuries that may result from incorrect use of equipment. Toward an automated approach to addressing these challenges, the authors of this work test the hypotheses that (i) there exists a difference in designers' comfort levels before and after they use a piece of engineering prototyping equipment and (ii) a machine learning model predicts the level of comfort a designer has while using engineering prototyping equipment with accuracies greater than random chance. It has been shown that the level of comfort that an individual has while completing a task impacts their performance. The authors investigate whether automatic tracking of designers' facial expressions during prototype creation predicts their level of comfort. A study, involving 37 participants using various engineering equipment, is used to validate the approach. The support vector machine (SVM) regression model yielded a range of R squared values from 0.82 to 0.86 for an equipment-specific model. A general model built to predict comfort level across all engineering equipment yielded an R squared value of 0.68. This work has the potential to transform the manner in which design teams utilize engineering equipment toward more efficient concept generation and prototype creation processes.

UR - http://www.scopus.com/inward/record.url?scp=85009084299&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85009084299&partnerID=8YFLogxK

U2 - 10.1115/1.4035428

DO - 10.1115/1.4035428

M3 - Article

AN - SCOPUS:85009084299

VL - 139

JO - Journal of Mechanical Design - Transactions of the ASME

JF - Journal of Mechanical Design - Transactions of the ASME

SN - 1050-0472

IS - 2

M1 - 2593214

ER -