Evaluating the performance of visual steering commands for user-guided Pareto frontier sampling during trade space exploration

Dan Carlsen, Matthew Malone, Josh Kollat, Timothy William Simpson

Research output: Chapter in Book/Report/Conference proceedingConference contribution

14 Citations (Scopus)

Abstract

Trade space exploration is a promising decision-making paradigm that provides a visual and more intuitive means for formulating, adjusting, and ultimately solving design optimization problems. This is achieved by combining multidimensional data visualization techniques with visual steering commands to allow designers to "steer" the optimization process while searching for the best, or Pareto optimal, designs. In this paper, we compare the performance of different combinations of visual steering commands implemented by two users to a multi-objective genetic algorithm that is executed "blindly" on the same problem with no human intervention. The results indicate that the visual steering commands - regardless of the combination in which they are invoked - provide a 4x -7x increase in the number of Pareto solutions that are obtained when the human is "in-the-loop" during the optimization process. As such, this study provides the first empirical evidence of the benefits of interactive visualizationbased strategies to support engineering design optimization and decision-making. Future work is also discussed.

Original languageEnglish (US)
Title of host publicationASME 2008 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, IDETC/CIE2008
Pages499-509
Number of pages11
EditionPARTS A AND B
DOIs
StatePublished - Dec 1 2008
EventASME 2008 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, IDETC/CIE2008 - Brooklyn, NY, United States
Duration: Aug 3 2008Aug 6 2008

Publication series

NameProceedings of the ASME Design Engineering Technical Conference
NumberPARTS A AND B
Volume1

Other

OtherASME 2008 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, IDETC/CIE2008
CountryUnited States
CityBrooklyn, NY
Period8/3/088/6/08

Fingerprint

Pareto
Sampling
Process Optimization
Decision making
Data visualization
Decision Making
Pareto Solutions
Multi-objective Genetic Algorithm
Multidimensional Data
Data Visualization
Engineering Design
Genetic algorithms
Intuitive
Paradigm
Optimization Problem
Trade
Vision
Design optimization
Human

All Science Journal Classification (ASJC) codes

  • Modeling and Simulation
  • Mechanical Engineering
  • Computer Science Applications
  • Computer Graphics and Computer-Aided Design

Cite this

Carlsen, D., Malone, M., Kollat, J., & Simpson, T. W. (2008). Evaluating the performance of visual steering commands for user-guided Pareto frontier sampling during trade space exploration. In ASME 2008 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, IDETC/CIE2008 (PARTS A AND B ed., pp. 499-509). (Proceedings of the ASME Design Engineering Technical Conference; Vol. 1, No. PARTS A AND B). https://doi.org/10.1115/DETC2008-49681
Carlsen, Dan ; Malone, Matthew ; Kollat, Josh ; Simpson, Timothy William. / Evaluating the performance of visual steering commands for user-guided Pareto frontier sampling during trade space exploration. ASME 2008 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, IDETC/CIE2008. PARTS A AND B. ed. 2008. pp. 499-509 (Proceedings of the ASME Design Engineering Technical Conference; PARTS A AND B).
@inproceedings{cb729307705e4f8ebaf2d713369214d3,
title = "Evaluating the performance of visual steering commands for user-guided Pareto frontier sampling during trade space exploration",
abstract = "Trade space exploration is a promising decision-making paradigm that provides a visual and more intuitive means for formulating, adjusting, and ultimately solving design optimization problems. This is achieved by combining multidimensional data visualization techniques with visual steering commands to allow designers to {"}steer{"} the optimization process while searching for the best, or Pareto optimal, designs. In this paper, we compare the performance of different combinations of visual steering commands implemented by two users to a multi-objective genetic algorithm that is executed {"}blindly{"} on the same problem with no human intervention. The results indicate that the visual steering commands - regardless of the combination in which they are invoked - provide a 4x -7x increase in the number of Pareto solutions that are obtained when the human is {"}in-the-loop{"} during the optimization process. As such, this study provides the first empirical evidence of the benefits of interactive visualizationbased strategies to support engineering design optimization and decision-making. Future work is also discussed.",
author = "Dan Carlsen and Matthew Malone and Josh Kollat and Simpson, {Timothy William}",
year = "2008",
month = "12",
day = "1",
doi = "10.1115/DETC2008-49681",
language = "English (US)",
isbn = "9780791843253",
series = "Proceedings of the ASME Design Engineering Technical Conference",
number = "PARTS A AND B",
pages = "499--509",
booktitle = "ASME 2008 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, IDETC/CIE2008",
edition = "PARTS A AND B",

}

Carlsen, D, Malone, M, Kollat, J & Simpson, TW 2008, Evaluating the performance of visual steering commands for user-guided Pareto frontier sampling during trade space exploration. in ASME 2008 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, IDETC/CIE2008. PARTS A AND B edn, Proceedings of the ASME Design Engineering Technical Conference, no. PARTS A AND B, vol. 1, pp. 499-509, ASME 2008 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, IDETC/CIE2008, Brooklyn, NY, United States, 8/3/08. https://doi.org/10.1115/DETC2008-49681

Evaluating the performance of visual steering commands for user-guided Pareto frontier sampling during trade space exploration. / Carlsen, Dan; Malone, Matthew; Kollat, Josh; Simpson, Timothy William.

ASME 2008 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, IDETC/CIE2008. PARTS A AND B. ed. 2008. p. 499-509 (Proceedings of the ASME Design Engineering Technical Conference; Vol. 1, No. PARTS A AND B).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Evaluating the performance of visual steering commands for user-guided Pareto frontier sampling during trade space exploration

AU - Carlsen, Dan

AU - Malone, Matthew

AU - Kollat, Josh

AU - Simpson, Timothy William

PY - 2008/12/1

Y1 - 2008/12/1

N2 - Trade space exploration is a promising decision-making paradigm that provides a visual and more intuitive means for formulating, adjusting, and ultimately solving design optimization problems. This is achieved by combining multidimensional data visualization techniques with visual steering commands to allow designers to "steer" the optimization process while searching for the best, or Pareto optimal, designs. In this paper, we compare the performance of different combinations of visual steering commands implemented by two users to a multi-objective genetic algorithm that is executed "blindly" on the same problem with no human intervention. The results indicate that the visual steering commands - regardless of the combination in which they are invoked - provide a 4x -7x increase in the number of Pareto solutions that are obtained when the human is "in-the-loop" during the optimization process. As such, this study provides the first empirical evidence of the benefits of interactive visualizationbased strategies to support engineering design optimization and decision-making. Future work is also discussed.

AB - Trade space exploration is a promising decision-making paradigm that provides a visual and more intuitive means for formulating, adjusting, and ultimately solving design optimization problems. This is achieved by combining multidimensional data visualization techniques with visual steering commands to allow designers to "steer" the optimization process while searching for the best, or Pareto optimal, designs. In this paper, we compare the performance of different combinations of visual steering commands implemented by two users to a multi-objective genetic algorithm that is executed "blindly" on the same problem with no human intervention. The results indicate that the visual steering commands - regardless of the combination in which they are invoked - provide a 4x -7x increase in the number of Pareto solutions that are obtained when the human is "in-the-loop" during the optimization process. As such, this study provides the first empirical evidence of the benefits of interactive visualizationbased strategies to support engineering design optimization and decision-making. Future work is also discussed.

UR - http://www.scopus.com/inward/record.url?scp=81155127543&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=81155127543&partnerID=8YFLogxK

U2 - 10.1115/DETC2008-49681

DO - 10.1115/DETC2008-49681

M3 - Conference contribution

AN - SCOPUS:81155127543

SN - 9780791843253

T3 - Proceedings of the ASME Design Engineering Technical Conference

SP - 499

EP - 509

BT - ASME 2008 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, IDETC/CIE2008

ER -

Carlsen D, Malone M, Kollat J, Simpson TW. Evaluating the performance of visual steering commands for user-guided Pareto frontier sampling during trade space exploration. In ASME 2008 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, IDETC/CIE2008. PARTS A AND B ed. 2008. p. 499-509. (Proceedings of the ASME Design Engineering Technical Conference; PARTS A AND B). https://doi.org/10.1115/DETC2008-49681