Listen "Can You Rely on Your AI? Applying the AIR Tool to Improve Classifier Performance"
Episode Synopsis
Modern analytic methods, including artificial intelligence (AI) and machine learning (ML) classifiers, depend on correlations; however, such approaches fail to account for confounding in the data, which prevents accurate modeling of cause and effect and often leads to prediction bias. The Software Engineering Institute (SEI) has developed a new AI Robustness (AIR) tool that allows users to gauge AI and ML classifier performance with unprecedented confidence. This project is sponsored by the Office of the Under Secretary of Defense for Research and Engineering to transition use of our AIR tool to AI users across the Department of Defense. During the webcast, the research team will hold a panel discussion on the AIR tool and discuss opportunities for collaboration. Our team efforts focus strongly on transition and provide guidance, training, and software that put our transition collaborators on a path to successful adoption of this technology to meet their AI/ML evaluation needs. What Attendees Will Learn: • How AIR adds analytical capability that didn't previously exist, enabling an analysis to characterize and measure the overall accuracy of the AI as the underlying environment changes • Examples of the AIR process and results from causal discovery to causal identification to causal inference • Opportunities for partnership and collaboration
More episodes of the podcast Software Engineering Institute (SEI) Webcast Series
5 Essential Questions for Implementing the Software Acquisition Pathway and the Tools to Tackle Them
23/10/2025
Q-Day Countdown: Are You Prepared?
15/10/2025
Using LLMs to Evaluate Code
02/10/2025
Identifying AI Talent for the DoD Workforce
18/07/2025
Model Your Way to Better Cybersecurity
10/07/2025
DevSecOps: See, Use, Succeed
27/06/2025
ZARZA We are Zarza, the prestigious firm behind major projects in information technology.