Algorithmically identifying strategies in multi-agent game-theoretic environments

Erin Zaroukian; Sebastian S. Rodriguez; Sean L. Barton; James A. Schaffer; Brandon Perelman; Nicholas R. Waytowich; Blaine Hoffman; Derrik E. Asher

doi:10.1117/12.2518609

10 May 2019 Algorithmically identifying strategies in multi-agent game-theoretic environments

Erin Zaroukian, Sebastian S. Rodriguez, Sean L. Barton, James A. Schaffer, Brandon Perelman, Nicholas R. Waytowich, Blaine Hoffman, Derrik E. Asher

Author Affiliations +

Proceedings Volume 11006, Artificial Intelligence and Machine Learning for Multi-Domain Operations Applications; 1100614 (2019) https://doi.org/10.1117/12.2518609
Event: SPIE Defense + Commercial Sensing, 2019, Baltimore, MD, United States

Abstract

Artificial intelligence (AI) has enormous potential for military applications. Fully realizing the conceived benefits of AI requires effective interactions among Soldiers and computational agents in highly uncertain and unconstrained operational environments. Because AI can be complex and unpredictable, computational agents should support their human teammates by adapting their behavior to the human’s elected strategy for a given task, facilitating mutuallyadaptive behavior within the team. While some situations entail explicit and easy-to-understand human top-down strategies, more often than not, human strategies tend to be implicit, ad hoc, exploratory, and difficult to describe. In order to facilitate mutually-adaptive human-agent team behavior, computational teammates must identify, adapt, and modify their behaviors to support human strategies with little or no a priori experience. This challenge may be achieved by training learning agents with examples of successful group strategies. Therefore, this paper focuses on an algorithmic approach to extract group strategies from multi-agent teaming behaviors in a game-theoretic environment: predator-prey pursuit. Group strategies are illuminated with a new method inspired from Graph Theory. This method treats agents as vertices to generate a timeseries of group dynamics and analytically compares timeseries segments to identify group coordinated behaviors. Ultimately, this approach may lead to the design of agents that can recognize and fall in line with strategies implicitly adopted by human teammates. This work can provide a substantial advance to the field of humanagent teaming by facilitating natural interactions within heterogeneous teams.

Conference Presentation

Citation Download Citation

Erin Zaroukian, Sebastian S. Rodriguez, Sean L. Barton, James A. Schaffer, Brandon Perelman, Nicholas R. Waytowich, Blaine Hoffman, and Derrik E. Asher "Algorithmically identifying strategies in multi-agent game-theoretic environments", Proc. SPIE 11006, Artificial Intelligence and Machine Learning for Multi-Domain Operations Applications, 1100614 (10 May 2019); https://doi.org/10.1117/12.2518609

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available