Warfighters will distrust AI-enabled systems that perform complex and high stakes work but do not effectively interact with humans. In many cases, this distrust in systems lacking effective Human-Machine Teaming (HMT) will be warranted, as poor teaming is often hazardous. Assurance is needed throughout development and fielding of AI-enabled systems to provide justified confidence that relational aspects of these systems are safe and effective. Particularly, developmental testing of HMT is critical because it enables HMT risks to be mitigated through AI-enabled system design. We present practical guidance for assessing HMT during developmental testing, including techniques, tools, and approaches that have the potential for immediate impact across the DoD Test and Evaluation (T&E) community. To further the adoption of HMT assessment in AI-enabled system assurance, we discuss DoD T&E domain-specific considerations which may support the development of guidance as well as future research.
To make progress in applying technological advancements towards multi-domain command and control (MDC2), including user-facing data collection and evaluation is critical but made more difficult by the lack of existing MDC2 systems. To address these challenges, we used a two-pronged approach that blended HMT Systems Engineering (SE) insights on designing user interfaces for artificial intelligence (AI) with MDC2 common operational picture (COP) research. We interviewed C2 operators using modified cognitive task analysis methods and analyzed data via thematic coding. User stories and future concept ideas were created from the interview data. The authors designed and delivered annotated mock-ups to reflect those concepts; they are in process of being incorporated into a software prototype. The designs were iteratively refined based on feedback from operators. The HMT SE guide, future concepts, annotated mockups, and prototypes are being shared with sponsors and used as foundational input for MITRE’s MDC2 exploration environment for FY19 and beyond. Products from this work include insights for how technology should support MDC2 planning and decision making, user stories capturing those insights and mock-up graphical concepts, and a set of design seeds for a future MDC2 Common Operational Picture, including layers, content, and other capabilities towards decision support.
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.