An extended study on addressing defender teamwork while accounting for uncertainty in attacker defender games using iterative Dec-MDPs

Eric Shieh, Albert Xin Jiang, Amulya Yadav, Pradeep Varakantham, Milind Tambe

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

Multi-agent teamwork and defender-attacker security games are two areas that are currently receiving significant attention within multi-agent systems research. Unfortunately, despite the need for effective teamwork among multiple defenders, little has been done to harness the teamwork research in security games. The problem that this paper seeks to solve is the coordination of decentralized defender agents in the presence of uncertainty while securing targets against an observing adversary. To address this problem, we offer the following novel contributions in this paper: (i) New model of security games with defender teams that coordinate under uncertainty; (ii) New algorithm based on column generation that utilizes Decentralized Markov Decision Processes (Dec-MDPs) to generate defender strategies that incorporate uncertainty; (iii) New techniques to handle global events (when one or more agents may leave the system) during defender execution; (iv) Heuristics that help scale up in the number of targets and agents to handle real-world scenarios; (v) Exploration of the robustness of randomized pure strategies. The paper opens the door to a potentially new area combining computational game theory and multi-agent teamwork.

Original languageEnglish (US)
Pages (from-to)189-226
Number of pages38
JournalMultiagent and Grid Systems
Volume11
Issue number4
DOIs
StatePublished - Jan 6 2016

Fingerprint

Game theory
Multi agent systems
Uncertainty

All Science Journal Classification (ASJC) codes

  • Computer Science(all)

Cite this

@article{5233d9eed09f4020aaed426c4e61ba99,
title = "An extended study on addressing defender teamwork while accounting for uncertainty in attacker defender games using iterative Dec-MDPs",
abstract = "Multi-agent teamwork and defender-attacker security games are two areas that are currently receiving significant attention within multi-agent systems research. Unfortunately, despite the need for effective teamwork among multiple defenders, little has been done to harness the teamwork research in security games. The problem that this paper seeks to solve is the coordination of decentralized defender agents in the presence of uncertainty while securing targets against an observing adversary. To address this problem, we offer the following novel contributions in this paper: (i) New model of security games with defender teams that coordinate under uncertainty; (ii) New algorithm based on column generation that utilizes Decentralized Markov Decision Processes (Dec-MDPs) to generate defender strategies that incorporate uncertainty; (iii) New techniques to handle global events (when one or more agents may leave the system) during defender execution; (iv) Heuristics that help scale up in the number of targets and agents to handle real-world scenarios; (v) Exploration of the robustness of randomized pure strategies. The paper opens the door to a potentially new area combining computational game theory and multi-agent teamwork.",
author = "Eric Shieh and Jiang, {Albert Xin} and Amulya Yadav and Pradeep Varakantham and Milind Tambe",
year = "2016",
month = "1",
day = "6",
doi = "10.3233/MGS-150236",
language = "English (US)",
volume = "11",
pages = "189--226",
journal = "Multiagent and Grid Systems",
issn = "1574-1702",
publisher = "IOS Press",
number = "4",

}

An extended study on addressing defender teamwork while accounting for uncertainty in attacker defender games using iterative Dec-MDPs. / Shieh, Eric; Jiang, Albert Xin; Yadav, Amulya; Varakantham, Pradeep; Tambe, Milind.

In: Multiagent and Grid Systems, Vol. 11, No. 4, 06.01.2016, p. 189-226.

Research output: Contribution to journalArticle

TY - JOUR

T1 - An extended study on addressing defender teamwork while accounting for uncertainty in attacker defender games using iterative Dec-MDPs

AU - Shieh, Eric

AU - Jiang, Albert Xin

AU - Yadav, Amulya

AU - Varakantham, Pradeep

AU - Tambe, Milind

PY - 2016/1/6

Y1 - 2016/1/6

N2 - Multi-agent teamwork and defender-attacker security games are two areas that are currently receiving significant attention within multi-agent systems research. Unfortunately, despite the need for effective teamwork among multiple defenders, little has been done to harness the teamwork research in security games. The problem that this paper seeks to solve is the coordination of decentralized defender agents in the presence of uncertainty while securing targets against an observing adversary. To address this problem, we offer the following novel contributions in this paper: (i) New model of security games with defender teams that coordinate under uncertainty; (ii) New algorithm based on column generation that utilizes Decentralized Markov Decision Processes (Dec-MDPs) to generate defender strategies that incorporate uncertainty; (iii) New techniques to handle global events (when one or more agents may leave the system) during defender execution; (iv) Heuristics that help scale up in the number of targets and agents to handle real-world scenarios; (v) Exploration of the robustness of randomized pure strategies. The paper opens the door to a potentially new area combining computational game theory and multi-agent teamwork.

AB - Multi-agent teamwork and defender-attacker security games are two areas that are currently receiving significant attention within multi-agent systems research. Unfortunately, despite the need for effective teamwork among multiple defenders, little has been done to harness the teamwork research in security games. The problem that this paper seeks to solve is the coordination of decentralized defender agents in the presence of uncertainty while securing targets against an observing adversary. To address this problem, we offer the following novel contributions in this paper: (i) New model of security games with defender teams that coordinate under uncertainty; (ii) New algorithm based on column generation that utilizes Decentralized Markov Decision Processes (Dec-MDPs) to generate defender strategies that incorporate uncertainty; (iii) New techniques to handle global events (when one or more agents may leave the system) during defender execution; (iv) Heuristics that help scale up in the number of targets and agents to handle real-world scenarios; (v) Exploration of the robustness of randomized pure strategies. The paper opens the door to a potentially new area combining computational game theory and multi-agent teamwork.

UR - http://www.scopus.com/inward/record.url?scp=84954457828&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84954457828&partnerID=8YFLogxK

U2 - 10.3233/MGS-150236

DO - 10.3233/MGS-150236

M3 - Article

AN - SCOPUS:84954457828

VL - 11

SP - 189

EP - 226

JO - Multiagent and Grid Systems

JF - Multiagent and Grid Systems

SN - 1574-1702

IS - 4

ER -