Best of - AI and safety critical systems

Today we're rerunning a conversation Russ had in 2020 with Mykel Kochenderfer, a professor of Aeronautics and Astronautics at Stanford University.Mykel's research has impacted anyone who has been on a plane recently for any kind of travel. His research led to the creation of a program known as the Airborne Collision Avoidance System, or ACAS X , which as he explains in more detail, is a critical tool in keeping air travel safe.Thank you for tuning in, and we hope you enjoy this episode from the archives.Chapter Time Stamps:(00:00:50) ACAS X OriginsRuss Altman sets the stage by revisiting a conversation from 2020 with Professor Mykel Kochenderfer, a pioneer in aeronautics and astronautics at Stanford University. They discuss Mykel's groundbreaking research leading to the creation of the Airborne Collision Avoidance System, ACAS X.(00:03:10) Ensuring Trustworthy Autonomous VehiclesExploring the challenges in building trustworthy autonomous systems, Mykel discusses the complexities of imperfect sensor systems, uncertainty in predicting future trajectory, and the trade-off between safety and operational efficiency.(00:07:20) Dynamic Programming: The Key to ACAS XMykel explains the role of dynamic programming in ACAS X, transforming complex computations into tractable tasks through offline modeling and a lookup table, balancing safety and efficiency.(00:10:30) Balancing Safety and EfficiencyRuss and Mykel delve into the intricate balance between safety and operational efficiency in ACAS X, highlighting the need for AI systems to make sound decisions even in rare, low-probability scenarios.(00:14:15) ACAS X Implementation and Use CasesMykel elaborates on the role of ACAS X in aviation safety, detailing its advisory nature and its integration with air traffic control systems, while addressing the potential automation in specific aircraft models.(00:17:40) Broadening Horizons: Urban Air MobilityExploring the expansion of ACAS X to urban air mobility systems, Russ and Mykel discuss the challenges of modeling and validating models for a wide range of aircraft, and the importance of incorporating human expertise.(00:21:05) Global Collaboration and AI ConsensusMykel emphasizes the collaborative nature of ACAS X implementation, involving different stakeholders, such as the FAA, Eurocontrol, and ICAO, and the role of AI in reaching a consensus on safety objectives.(00:23:30) The Journey AheadAs the conversation draws to a close, Mykel reflects on the evolution of ACAS X, its future applications, and the fusion of AI and human wisdom shaping the skies of tomorrow.