Advancements in Human–Agent Teaming Research Infrastructure: Testbeds, Metrics, and Concepts

As modern military operations become more complex, the need for rapid, coordinated decision-making across multiple domains―air, land, maritime, space, and cyberspace―has never been greater. The U.S. Department of War has identified artificial intelligence (AI) as a critical tool in overcoming these challenges, enabling faster and more efficient responses in high-stakes environments. However, for AI to be effective, it must function well within human teams and organizational structures. This book explores the evolving role of AI in military and defense operations, with a focus on how human-AI teams can be optimized for success.

This title offers a practical guide to the next generation of human-AI teaming. Built on the findings of a major research initiative led by the National Academies Board on Human-Systems Integration, this book compiles key insights into the infrastructure, metrics, and conceptual frameworks essential for advancing human-AI collaboration. Readers will gain an understanding of the latest testbed research, validated performance metrics, and novel but critical concepts for evaluating human-AI teams. This book provides a foundation for improving decision-making and coordination in complex operational settings.

Advancements in Human Agent Teaming Research Infrastructure: Testbeds, Metrics, and Concepts is an essential resource for researchers, engineers, and policymakers working in AI development, human factors, and defense strategy. It will also benefit military professionals and industry leaders seeking to understand how AI can enhance operational effectiveness while maintaining human oversight and trust.

Dr. Erin K. Chiou is an Associate Professor of Human Systems Engineering at Arizona State University, USA, with a Ph.D. in Industrial and Systems Engineering from the University of Wisconsin Madison, USA. Her research leverages social and psychological science to improve human-automation work system design. Recent projects have focused on AI-enabled decision support systems with applications in complex and safety critical settings. She directs the Automation Design Advancing People and Technology Laboratory.

Dr. Jason H. Wong is a Senior Cognitive Scientist with a Ph.D. in Human Factors and Applied Cognitive Psychology from George Mason University, USA. His work leverages cognitive science to optimize how people use emerging technologies. Currently focused on human-AI teaming in defense, his expertise also includes human-centered design for augmented reality and aligning training systems with human performance and learning principles.

Dr. Douglas S. Lange is a Senior Scientist in Machine Learning and Artificial Intelligence with a Ph.D. in Computer Software Engineering from the Naval Postgraduate School, USA. He has extensive experience in research, development, and technology insertion for current and future command, control, communications, computers, intelligence, surveillance, and reconnaissance (C4ISR) systems.

Dr. Julie Marble directs research in Human-Autonomy Teaming at the Applied Research Laboratory for Intelligence & Security with a Ph.D. in Human Factors and Cognitive Psychology from Purdue University, USA. She has more than 25 years of experience in human-machine teaming, human-robot interaction, and human reliability analysis, and is a member of the Board on Human-System Integration at the National Academies of Science, Engineering, and Medicine.