A differential game approach to dynamic competitive decisions toward human-computer collaboration

Alparslan Emrah Bayrak, Jonathan Cagan, Christopher McComb, Kenneth Kotovsky

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Partnership between humans and computers has a significant potential to extend the ability of humans to address complex design problems. This paper presents a decision-making process for computers to effectively collaborate with humans in the solution of complex problems under dynamic competition. In the proposed process, the computers learn strategies and objectives from prior experimental data and provide strategy suggestions to human collaborators. The study integrates clustering and sequential learning methods from machine learning with a differential game formulation based on model predictive control to find dynamic Nash equilibrium solutions to zero-sum games. The application of the proposed approach is demonstrated on the real-time strategy game Starcraft II that offers a dynamic competitive problem comparable in complexity to real-world applications. The results show that the proposed approach can successfully identify a variety of opening strategies in the experimental data for the initial phase of the process. The game-theoretic strategies in the later phases provide useful suggestions for low-performing players but are unnecessarily conservative for high-performing players where there is little opportunity for improvement. These results suggest a need for an assessment of the opponent expertise and a human intuition to judge the appropriateness of the game-theoretic suggestions for further improvement.

complex systems, dynamic competition, differential games, human-computer collaboration

Original languageEnglish (US)
Title of host publication31st International Conference on Design Theory and Methodology
PublisherAmerican Society of Mechanical Engineers (ASME)
ISBN (Electronic)9780791859278
DOIs
StatePublished - Jan 1 2019
EventASME 2019 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, IDETC-CIE 2019 - Anaheim, United States
Duration: Aug 18 2019Aug 21 2019

Publication series

NameProceedings of the ASME Design Engineering Technical Conference
Volume7

Conference

ConferenceASME 2019 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, IDETC-CIE 2019
CountryUnited States
CityAnaheim
Period8/18/198/21/19

All Science Journal Classification (ASJC) codes

  • Mechanical Engineering
  • Computer Graphics and Computer-Aided Design
  • Computer Science Applications
  • Modeling and Simulation

Fingerprint Dive into the research topics of 'A differential game approach to dynamic competitive decisions toward human-computer collaboration'. Together they form a unique fingerprint.

  • Cite this

    Bayrak, A. E., Cagan, J., McComb, C., & Kotovsky, K. (2019). A differential game approach to dynamic competitive decisions toward human-computer collaboration. In 31st International Conference on Design Theory and Methodology (Proceedings of the ASME Design Engineering Technical Conference; Vol. 7). American Society of Mechanical Engineers (ASME). https://doi.org/10.1115/DETC2019-97619