Practical guidance for human-machine teaming assurance of AI-enabled systems

Glenn J. Lematta; Patricia L. McDermott; Cindy Dominguez

doi:10.1117/12.3013931

7 June 2024 Practical guidance for human-machine teaming assurance of AI-enabled systems

Glenn J. Lematta, Patricia L. McDermott, Cindy Dominguez

Proceedings Volume 13054, Assurance and Security for AI-enabled Systems; 130540D (2024) https://doi.org/10.1117/12.3013931
Event: SPIE Defense + Commercial Sensing, 2024, National Harbor, Maryland, United States

Abstract

Warfighters will distrust AI-enabled systems that perform complex and high stakes work but do not effectively interact with humans. In many cases, this distrust in systems lacking effective Human-Machine Teaming (HMT) will be warranted, as poor teaming is often hazardous. Assurance is needed throughout development and fielding of AI-enabled systems to provide justified confidence that relational aspects of these systems are safe and effective. Particularly, developmental testing of HMT is critical because it enables HMT risks to be mitigated through AI-enabled system design. We present practical guidance for assessing HMT during developmental testing, including techniques, tools, and approaches that have the potential for immediate impact across the DoD Test and Evaluation (T&E) community. To further the adoption of HMT assessment in AI-enabled system assurance, we discuss DoD T&E domain-specific considerations which may support the development of guidance as well as future research.

Conference Presentation

Citation Download Citation

Glenn J. Lematta, Patricia L. McDermott, and Cindy Dominguez "Practical guidance for human-machine teaming assurance of AI-enabled systems", Proc. SPIE 13054, Assurance and Security for AI-enabled Systems, 130540D (7 June 2024); https://doi.org/10.1117/12.3013931

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available