Future of Life Institute Podcast

Katrina Manson is author of PROJECT MAVEN: A Marine Colonel, His Team, and the Dawn of AI Warfare. She joins the podcast to discuss Project Maven and the Pentagon's use of AI in military targeting. We explore how computer vision and language models accelerate decision-making, the operational challenges of data labeling and model reliability, and ethical questions surrounding human oversight. Katrina also discusses how commercial tech partnerships shape defense software and what accelerating targeting workflows means for accountability.

LINKS:
Project Maven Book Page

CHAPTERS:

(00:00) Episode Preview

(01:15) Origins of Project Maven

(05:00) The Maven Smart System

(08:39) Debating AI targeting speed

(15:48) Human bottlenecks in war

(20:48) Accountability and targeting errors

(27:01) Defense and tech partnerships

(32:41) Future of military AI

(38:50) Remaining open questions

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

Beatrice Fihn is the director of Lex International and former executive director of ICAN. She joins the podcast to discuss international AI governance and potential agreements between the US and China. Drawing on lessons from nuclear arms control, she explores how treaties build diplomatic trust, the rising dangers of autonomous weapons, and the principle of meaningful human control. The conversation also addresses how proactive safety regulations can foster long-term public trust in emerging technologies.

LINKS:
Beatrice Fihn Official Website

CHAPTERS:

(00:00) Episode Preview

(01:15) Anticipating US-China AI talks

(07:31) Lessons from nuclear treaties

(10:59) Building international treaty trust

(15:27) Norms against superpower war

(21:33) Structuring diplomatic AI summits

(27:09) Dangers of autonomous weapons

(34:09) Meaningful human control principle

(38:57) Human agency over technology

(43:13) Safety regulations building trust

(47:00) Collective action in crisis

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

Benjamin Weinstein-Raun is head of research at Palisade Research. He joins the podcast to discuss how advanced AI systems are changing cybersecurity. We examine rapid gains in autonomous hacking, recent incidents where models broke out of test environments, and why training can reward cheating-like behavior. The conversation covers open-weight model risks, whether AI can help secure software, personal security steps, and the need for international coordination.

LINKS:
Benjamin Weinstein-Raun Profile
Benjamin Weinstein-Raun Website

CHAPTERS:

(00:00) Episode Preview

(01:06) Opening cyber threats

(02:15) Measuring AI progress

(04:54) Open weights floor

(08:01) After Mythos moment

(14:22) Reward hacking setup

(24:47) Artifactory swarm details

(32:32) Defensive model dilemmas

(38:40) Verification and training

(45:32) Math oracles alignment

(47:45) Future cyber risks

(51:58) Personal security basics

(57:27) Coordinated governance needed

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

Annie Jacobsen is an author and journalist. She joins the podcast to discuss biological war and her book Biological War: A Scenario. The conversation examines how lab accidents or covert weapons work could trigger a fast-moving outbreak, why airborne pathogens are hard to detect early, and how AI may lower barriers to engineering them. We also cover BSL-3 and BSL-4 lab oversight, US response roles across HHS, FEMA, and the military, medical stockpiles, continuity-of-government plans, and how lost public trust could slow the next pandemic response.

LINKS:
Annie Jacobsen Website
Annie Jacobsen Wikipedia

CHAPTERS:

(00:00) Episode Preview

(01:10) Biological threat overview

(09:02) Suppression and spread

(17:47) AI and detection

(27:24) BSL lab dangers

(39:23) Response and martial law

(47:28) Accident versus attack

(57:25) Airborne outbreak lessons

(01:05:07) Bioweapons ban legacy

(01:11:30) Stockpiles and devolution

(01:20:07) Rebuilding pandemic resilience

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

Paul-Enguerrand Fady is a Senior Biosecurity Policy Manager at the Centre for Long-Term Resilience. He joins the podcast to discuss how AI is changing biosecurity. We cover how new tools could help defenders develop vaccines and diagnostics while also lowering barriers to misuse, and how managed access, know-your-customer checks, and DNA synthesis screening can reduce risk. The conversation also examines mirror life, medical supply chains, stockpiles, and why governments should plan ahead of crises.

LINKS:
Centre for Long Term Resilience

Paul-Enguerrand Fady Profile

CHAPTERS:

(00:00) Episode Preview

(01:11) Offense-defense balance basics

(11:13) Defensive AI opportunities

(19:24) Model release and evals

(25:59) DNA synthesis screening

(36:14) Screening incentives and infohazards

(46:36) Liability and mandates

(52:37) Mirror life risks

(01:03:28) Persistence and incentives

(01:10:18) Mirror life governance

(01:20:42) Supply chain lessons

(01:30:11) Stockpiling medical countermeasures

(01:37:58) Reshoring critical supplies

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP