As the Defense Department accelerates incorporating artificial intelligence (AI) in all aspects of defense, the importance of rigorous test and evaluation (T&E) grows. In this webinar, contributors to the Developmental Test, Evaluation, and Assessment (DTE&A) T&E of AI Guidebook will offer practical insights on T&E of AI systems. Attendees will learn how to integrate this guidance into their existing perspectives. The speakers will share surprising lessons learned, highlight opportunities for collaboration on future updates, and provide direct avenues for follow-up. This session will provide a starting point on ways to navigate the complexities of AI T&E to ensure robust and reliable systems. The following topics will be addressed:
- Applying Modeling and Simulation to AI Developmental Test – Practical approaches for leveraging simulation environments to support rigorous early-stage evaluation of AI-enabled systems.
- Integrating Formal Methods and Enhancing Model Transparency – How formal verification techniques and visibility into machine-learning models can improve testability and assurance.
- Design Tradeoffs and Their Impact on Test Strategy – Lessons learned on how early development decisions affect T&E outcomes and guidance on aligning test plans with AI system design.