Future of Life Institute Podcast
Alle afleveringen
281 afleveringen, van nieuw naar oud
-
How AI Is Changing Human Psychology (with Meia Chita-Tegmark)
27 oktober 2026 · 1 uur 15 min
Meia Chita-Tegmark is a co-founder of the Future of Life Institute. She joins the podcast to discuss how artificial intelligence influences human psychology and behavior. The conversation explores psychological disengagement, the rise of sycophantic AI companions, and risks of emotional manipulation. Meia examines how these systems exploit cognitive vulnerabilities, the dangers of anthropomorphizing non-human agents, and why psychological research and regulation must evolve to track emerging societal harms. Lees meer
LINKS:
Meia Chita-Tegmark Profile Page
CHAPTERS:
(00:00) Episode Preview
(00:58) Introduction and disengagement
(06:32) Generativity and delegation
(09:20) AI companions and parasocial relationships
(15:53) Psychological manipulation techniques
(20:20) Company incentives and data exploitation
(25:35) AI as social training tool
(29:01) Embodiment and authentic connection
(34:03) Superiority of AI persuasion
(37:46) Psychosis and delusional thinking
(42:29) Why we choose disengagement
(47:08) Usage patterns and lack of data
(52:45) AI consciousness and legal personhood
(57:36) Bot-to-bot interactions and empathy
(01:03:50) Unresolved consciousness questions
(01:07:42) Teaching psychology students
(01:12:11) Accelerating academic research
PRODUCED BY:
https://aipodcast.ing
SOCIAL LINKS:
Website: https://podcast.futureoflife.org
Twitter (FLI): https://x.com/FLI_org
Twitter (Gus): https://x.com/gusdocker
LinkedIn: https://www.linkedin.com/company/future-of-life-institute/
YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/
Apple: https://geo.itunes.apple.com/us/podcast/id1170991978
Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP
-
Artificial Intimacy: When Machines Pursue Our Attachment (with Sherry Turkle)
22 oktober 2026 · 1 uur 8 min
Sherry Turkle is a professor of sociology and personality psychology at MIT. She joins the podcast to discuss artificial intimacy and the psychological impact of emotional attachment to AI chatbots. We examine why people turn to machines for empathy and companionship, how conversational agents exploit human vulnerabilities, and the specific risks for children and the elderly. Turkle also explains the importance of solitude, boredom, and vulnerability, emphasizing why society must invest in physical communities to reclaim human connection. Lees meer
LINKS:
Sherry Turkle Official Website
Sherry Turkle Author Biography
CHAPTERS:
(00:00) Episode Preview
(01:10) Defining artificial intimacy
(10:12) Protecting vulnerable populations
(21:40) Intimacy requires vulnerability
(33:12) Dangers of AI therapy
(45:44) Embracing solitude and boredom
(56:47) Reclaiming the real world
PRODUCED BY:
https://aipodcast.ing
SOCIAL LINKS:
Website: https://podcast.futureoflife.org
Twitter (FLI): https://x.com/FLI_org
Twitter (Gus): https://x.com/gusdocker
LinkedIn: https://www.linkedin.com/company/future-of-life-institute/
YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/
Apple: https://geo.itunes.apple.com/us/podcast/id1170991978
Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP
-
The Trillion-Dollar AI Race to Replace Us (with Garrison Lovely)
13 oktober 2026 · 1 uur 20 min
Garrison Lovely is an author and journalist. He joins the podcast to discuss the race to replace human labor with artificial general intelligence. We explore the political risks of worker displacement and lessons from historical precedents like the nuclear freeze movement. Garrison also examines rising public opposition to AI data centers and outlines strategies for organizing collective action to steer technological development. Lees meer
LINKS:
Obsolete Book Official Website
Garrison Lovely Official Website
CHAPTERS:
(00:00) Episode Preview
(00:53) Universal labor replacement
(08:17) Economic obsolescence and power
(16:47) Replacement versus extinction risk
(31:54) The AI bubble debate
(47:24) Rising public backlash
(01:00:53) Lessons from nuclear freeze
(01:10:16) AGI is not inevitable
(01:16:41) Organizing collective action
PRODUCED BY:
https://aipodcast.ing
SOCIAL LINKS:
Website: https://podcast.futureoflife.org
Twitter (FLI): https://x.com/FLI_org
Twitter (Gus): https://x.com/gusdocker
LinkedIn: https://www.linkedin.com/company/future-of-life-institute/
YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/
Apple: https://geo.itunes.apple.com/us/podcast/id1170991978
Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP
-
Delisted: A Film About AI-Powered Social Erasure (with Michael Patrick Clarkson)
6 oktober 2026 · 58 min
Michael Patrick Clarkson is the writer and director of the film Delisted. Lees meer
Watch the film here.
He joins the podcast to discuss how artificial intelligence could enable state surveillance, social control, and the digital erasure of dissenters. The conversation explores the societal costs of widespread automation across education and labor, the risks of public-private partnerships in technology oversight, and the importance of preserving human connection and creative agency amid rapid technological change.
LINKS:
Delisted Film Official Website
CHAPTERS:
(00:00) Episode Preview
(01:18) Introducing the film Delisted
(04:18) Public and private surveillance
(09:53) Human cost of automation
(15:06) Losing connection through technology
(21:48) Social divisions over automation
(25:56) Communicating the AI warning
(31:40) State surveillance and erasure
(39:33) Escapism and systemic exhaustion
(44:06) Becoming more human
(50:16) Discarding the AI creators
PRODUCED BY:
https://aipodcast.ing
SOCIAL LINKS:
Website: https://podcast.futureoflife.org
Twitter (FLI): https://x.com/FLI_org
Twitter (Gus): https://x.com/gusdocker
LinkedIn: https://www.linkedin.com/company/future-of-life-institute/
YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/
Apple: https://geo.itunes.apple.com/us/podcast/id1170991978
Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP
-
Visualizing Moloch: A Short Film About the AI Race (with Tom Cozens)
29 september 2026 · 1 uur 39 min
Tom Cozens is a filmmaker and writer. He joins the podcast to discuss his short film Moloch and the dynamics of competitive races in artificial intelligence. Lees meer
Watch the film here.
We explore the philosophical and theological themes behind the film and the challenge of depicting near-future AI agents on screen. Tom also discusses the role of cinema in communicating existential dread, definitions of human flourishing, and the need to coordinate against destructive systemic incentives.
LINKS:
Moloch Film Official Website
Tom Cozens Official Website
CHAPTERS:
(00:00) Episode Preview
(00:59) The concept of Moloch
(03:28) Visualizing Moloch on screen
(15:21) Parable of cosmic horror
(22:37) Theological and philosophical themes
(35:10) Depicting near-future AI agents
(50:15) Inspiration from Metropolis
(01:04:58) Sound design and score
(01:13:16) AI industry incentive structures
(01:18:27) Defining human flourishing
(01:28:59) Embodiment versus digital minds
(01:34:33) Challenging systemic presuppositions
PRODUCED BY:
https://aipodcast.ing
SOCIAL LINKS:
Website: https://podcast.futureoflife.org
Twitter (FLI): https://x.com/FLI_org
Twitter (Gus): https://x.com/gusdocker
LinkedIn: https://www.linkedin.com/company/future-of-life-institute/
YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/
Apple: https://geo.itunes.apple.com/us/podcast/id1170991978
Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP
-
Can Humans Still Control AI-Assisted Kill Chains? (with Katrina Manson)
25 september 2026 · 42 min
Katrina Manson is author of PROJECT MAVEN: A Marine Colonel, His Team, and the Dawn of AI Warfare. She joins the podcast to discuss Project Maven and the Pentagon's use of AI in military targeting. We explore how computer vision and language models accelerate decision-making, the operational challenges of data labeling and model reliability, and ethical questions surrounding human oversight. Katrina also discusses how commercial tech partnerships shape defense software and what accelerating targeting workflows means for accountability. Lees meer
LINKS:
Project Maven Book Page
CHAPTERS:
(00:00) Episode Preview
(01:15) Origins of Project Maven
(05:00) The Maven Smart System
(08:39) Debating AI targeting speed
(15:48) Human bottlenecks in war
(20:48) Accountability and targeting errors
(27:01) Defense and tech partnerships
(32:41) Future of military AI
(38:50) Remaining open questions
PRODUCED BY:
https://aipodcast.ing
SOCIAL LINKS:
Website: https://podcast.futureoflife.org
Twitter (FLI): https://x.com/FLI_org
Twitter (Gus): https://x.com/gusdocker
LinkedIn: https://www.linkedin.com/company/future-of-life-institute/
YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/
Apple: https://geo.itunes.apple.com/us/podcast/id1170991978
Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP
-
What Would a US-China AI Deal Look Like? (with Beatrice Fihn)
10 september 2026 · 52 min
Beatrice Fihn is the director of Lex International and former executive director of ICAN. She joins the podcast to discuss international AI governance and potential agreements between the US and China. Drawing on lessons from nuclear arms control, she explores how treaties build diplomatic trust, the rising dangers of autonomous weapons, and the principle of meaningful human control. The conversation also addresses how proactive safety regulations can foster long-term public trust in emerging technologies. Lees meer
LINKS:
Beatrice Fihn Official Website
CHAPTERS:
(00:00) Episode Preview
(01:15) Anticipating US-China AI talks
(07:31) Lessons from nuclear treaties
(10:59) Building international treaty trust
(15:27) Norms against superpower war
(21:33) Structuring diplomatic AI summits
(27:09) Dangers of autonomous weapons
(34:09) Meaningful human control principle
(38:57) Human agency over technology
(43:13) Safety regulations building trust
(47:00) Collective action in crisis
PRODUCED BY:
https://aipodcast.ing
SOCIAL LINKS:
Website: https://podcast.futureoflife.org
Twitter (FLI): https://x.com/FLI_org
Twitter (Gus): https://x.com/gusdocker
LinkedIn: https://www.linkedin.com/company/future-of-life-institute/
YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/
Apple: https://geo.itunes.apple.com/us/podcast/id1170991978
Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP
-
Why AI Hacking Is Becoming Hard to Control (with Benjamin Weinstein-Raun)
28 augustus 2026 · 59 min
Benjamin Weinstein-Raun is head of research at Palisade Research. He joins the podcast to discuss how advanced AI systems are changing cybersecurity. We examine rapid gains in autonomous hacking, recent incidents where models broke out of test environments, and why training can reward cheating-like behavior. The conversation covers open-weight model risks, whether AI can help secure software, personal security steps, and the need for international coordination. Lees meer
LINKS:
Benjamin Weinstein-Raun Profile
Benjamin Weinstein-Raun Website
CHAPTERS:
(00:00) Episode Preview
(01:06) Opening cyber threats
(02:15) Measuring AI progress
(04:54) Open weights floor
(08:01) After Mythos moment
(14:22) Reward hacking setup
(24:47) Artifactory swarm details
(32:32) Defensive model dilemmas
(38:40) Verification and training
(45:32) Math oracles alignment
(47:45) Future cyber risks
(51:58) Personal security basics
(57:27) Coordinated governance needed
PRODUCED BY:
https://aipodcast.ing
SOCIAL LINKS:
Website: https://podcast.futureoflife.org
Twitter (FLI): https://x.com/FLI_org
Twitter (Gus): https://x.com/gusdocker
LinkedIn: https://www.linkedin.com/company/future-of-life-institute/
YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/
Apple: https://geo.itunes.apple.com/us/podcast/id1170991978
Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP
-
First 24 Hours of a Bioweapon Attack - Annie Jacobsen
21 augustus 2026 · 1 uur 28 min
Annie Jacobsen is an author and journalist. She joins the podcast to discuss biological war and her book Biological War: A Scenario. The conversation examines how lab accidents or covert weapons work could trigger a fast-moving outbreak, why airborne pathogens are hard to detect early, and how AI may lower barriers to engineering them. We also cover BSL-3 and BSL-4 lab oversight, US response roles across HHS, FEMA, and the military, medical stockpiles, continuity-of-government plans, and how lost public trust could slow the next pandemic response. Lees meer
LINKS:
Annie Jacobsen Website
Annie Jacobsen Wikipedia
CHAPTERS:
(00:00) Episode Preview
(01:10) Biological threat overview
(09:02) Suppression and spread
(17:47) AI and detection
(27:24) BSL lab dangers
(39:23) Response and martial law
(47:28) Accident versus attack
(57:25) Airborne outbreak lessons
(01:05:07) Bioweapons ban legacy
(01:11:30) Stockpiles and devolution
(01:20:07) Rebuilding pandemic resilience
PRODUCED BY:
https://aipodcast.ing
SOCIAL LINKS:
Website: https://podcast.futureoflife.org
Twitter (FLI): https://x.com/FLI_org
Twitter (Gus): https://x.com/gusdocker
LinkedIn: https://www.linkedin.com/company/future-of-life-institute/
YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/
Apple: https://geo.itunes.apple.com/us/podcast/id1170991978
Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP
-
How AI Shifts the Offense-Defense Balance in Biosecurity (with Paul-Enguerrand Fady)
7 augustus 2026 · 1 uur 49 min
Paul-Enguerrand Fady is a Senior Biosecurity Policy Manager at the Centre for Long-Term Resilience. He joins the podcast to discuss how AI is changing biosecurity. We cover how new tools could help defenders develop vaccines and diagnostics while also lowering barriers to misuse, and how managed access, know-your-customer checks, and DNA synthesis screening can reduce risk. The conversation also examines mirror life, medical supply chains, stockpiles, and why governments should plan ahead of crises. Lees meer
LINKS:
Centre for Long Term Resilience
Paul-Enguerrand Fady Profile
CHAPTERS:
(00:00) Episode Preview
(01:11) Offense-defense balance basics
(11:13) Defensive AI opportunities
(19:24) Model release and evals
(25:59) DNA synthesis screening
(36:14) Screening incentives and infohazards
(46:36) Liability and mandates
(52:37) Mirror life risks
(01:03:28) Persistence and incentives
(01:10:18) Mirror life governance
(01:20:42) Supply chain lessons
(01:30:11) Stockpiling medical countermeasures
(01:37:58) Reshoring critical supplies
PRODUCED BY:
https://aipodcast.ing
SOCIAL LINKS:
Website: https://podcast.futureoflife.org
Twitter (FLI): https://x.com/FLI_org
Twitter (Gus): https://x.com/gusdocker
LinkedIn: https://www.linkedin.com/company/future-of-life-institute/
YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/
Apple: https://geo.itunes.apple.com/us/podcast/id1170991978
Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP
-
Why AI Evaluations Are Broken and How to Fix Them (with David Manheim)
17 juli 2026 · 1 uur 19 min
David Manheim is head of methodology at AI Evaluation Consensus. He joins the podcast to discuss how AI evaluations can become more reliable, transparent, and useful for decisions. We cover common failures such as unclear reporting, training to the test, benchmark saturation, and models changing behavior when they know they are being tested. The conversation also examines real-world tests, biosecurity, persuasion, forecasting, human oversight, and why even “normal” AI progress could be disruptive. Lees meer
LINKS:
David Manheim website
AI Evaluation Consensus Statement
CHAPTERS:
(00:00) Episode Preview
(01:04) Evaluation consensus project
(07:01) Evaluation awareness challenges
(12:28) Reporting capabilities clearly
(19:38) Benchmarks beyond humans
(29:52) Proxies and biosecurity
(42:01) Persuasion and democracy
(53:59) Forecasting with AI
(01:08:44) Oversight and disruption
(01:16:42) Supporting better evals
PRODUCED BY:
https://aipodcast.ing
SOCIAL LINKS:
Website: https://podcast.futureoflife.org
Twitter (FLI): https://x.com/FLI_org
Twitter (Gus): https://x.com/gusdocker
LinkedIn: https://www.linkedin.com/company/future-of-life-institute/
YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/
Apple: https://geo.itunes.apple.com/us/podcast/id1170991978
Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP
-
How AI Is Replacing Children's Ability to Think (with Randi Weingarten)
30 juni 2026 · 44 min
Randi Weingarten is president of the American Federation of Teachers. She joins the podcast to discuss AI in education. The conversation covers how screens and student-facing AI may weaken attention, learning, and trust, why she supports limiting screens for young children and social chatbots for students under 16, and how teachers can use AI without replacing thinking. She also discusses active learning, data privacy, independent research on AI in education, and guardrails for schools. Lees meer
LINKS:
Randi Weingarten Wikipedia
AFT Randi Weingarten Profile
American Federation of Teachers
CHAPTERS:
(00:00) Episode Preview
(01:13) AI education wake-up
(07:27) Active learning versus AI
(14:42) Preserving thinking habits
(20:06) Research and screen limits
(26:05) Social chatbot risks
(30:20) Data privacy standards
(35:58) Classroom AI guardrails
(41:13) Companies and future schools
PRODUCED BY:
https://aipodcast.ing
SOCIAL LINKS:
Website: https://podcast.futureoflife.org
Twitter (FLI): https://x.com/FLI_org
Twitter (Gus): https://x.com/gusdocker
LinkedIn: https://www.linkedin.com/company/future-of-life-institute/
YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/
Apple: https://geo.itunes.apple.com/us/podcast/id1170991978
Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP
-
The Gulf Between AI Progress and Political Understanding (with Dex Hunter-Torricke)
25 juni 2026 · 1 uur 4 min
Dex Hunter-Torricke is founder of the Centre for Tomorrow. He joins the podcast to discuss why AI governance needs to move beyond technical fixes. The conversation covers how AI companies make decisions, why policymakers often misunderstand agents and economic change, and how automation could reshape jobs, welfare, taxation, and global trade. Dex argues that societies need broader political planning before a crisis drives rushed choices. Lees meer
LINKS:
Dex Hunter-Torricke Website
Center for Tomorrow Website
CHAPTERS:
(00:00) Episode Preview
(01:09) Dex's technology journey
(08:22) Broken AI governance
(18:00) Big tech blindspots
(27:36) Employee power shifts
(37:18) Global views and UBI
(48:17) Power and displacement
(01:00:54) Reasons for optimism
PRODUCED BY:
https://aipodcast.ing
SOCIAL LINKS:
Website: https://podcast.futureoflife.org
Twitter (FLI): https://x.com/FLI_org
Twitter (Gus): https://x.com/gusdocker
LinkedIn: https://www.linkedin.com/company/future-of-life-institute/
YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/
Apple: https://geo.itunes.apple.com/us/podcast/id1170991978
Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP
-
How AI Companions Trap Users Through Addictive Design (with Claire Boine)
12 juni 2026 · 1 uur 8 min
Claire Boine is an assistant professor in technology, law, and AI governance at the European University Institute. She joins the podcast to discuss AI companions and human attachment. The conversation examines how design choices and free-to-start business models can foster dependency, expose intimate data, and blur the lines between therapy, romance, and manipulation. We also cover risks for children and teens, gaps in EU and US law, and why AI policy should distinguish technical alignment from incentives and social harms. Lees meer
LINKS:
Claire Boine Website
Successif Organization Website
CHAPTERS:
(00:00) Episode Preview
(01:06) Introducing Claire Boine
(02:05) Companion app designs
(06:23) Feelings and freemium
(14:28) Users, attachment, harms
(25:06) Age-based risks
(35:18) Future relationship norms
(41:05) Legal loopholes today
(44:19) Rethinking alignment framing
(57:19) Narratives and fiduciaries
(01:05:47) Collective policy action
PRODUCED BY:
https://aipodcast.ing
SOCIAL LINKS:
Website: https://podcast.futureoflife.org
Twitter (FLI): https://x.com/FLI_org
Twitter (Gus): https://x.com/gusdocker
LinkedIn: https://www.linkedin.com/company/future-of-life-institute/
YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/
Apple: https://geo.itunes.apple.com/us/podcast/id1170991978
Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP
-
Why AI Chatbots Are a Rival to the Family (with Michael Toscano)
26 mei 2026 · 1 uur 14 min
Michael Toscano is a Senior Fellow at the Institute for Family Studies and Director of its Family First Technology Initiative. He joins the podcast to discuss family-centered AI policy. The conversation covers AI companions, self-harm risks, sexualized chatbots, education, smartphones in schools, and why "infinite patience" can harm children's growth. Toscano also explains Catholic social teaching, public pushback against rapid AI deployment, and why society-wide governance may be needed to keep technology accountable to families. Lees meer
LINKS:
Michael Toscano
CHAPTERS:
(00:00) Episode Preview
(01:12) Family centered AI
(09:54) Companion design harms
(17:23) Technology and family
(25:48) Society wide governance
(33:09) Catholic AI response
(39:44) Double movement politics
(49:36) Technology mythos challenged
(59:48) Competition and control
PRODUCED BY:
https://aipodcast.ing
SOCIAL LINKS:
Website: https://podcast.futureoflife.org
Twitter (FLI): https://x.com/FLI_org
Twitter (Gus): https://x.com/gusdocker
LinkedIn: https://www.linkedin.com/company/future-of-life-institute/
YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/
Apple: https://geo.itunes.apple.com/us/podcast/id1170991978
Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP
-
Why We Should Build AI Tools, Not AI Replacements (with Anthony Aguirre)
11 mei 2026 · 1 uur 36 min
Anthony Aguirre is the CEO of the Future of Life Institute. He joins the podcast to discuss A Better Path for AI, his essay series on steering AI away from races to replace people. The conversation covers races for attention, attachment, automation, and superintelligence, and how these can concentrate power and undermine human agency. Anthony argues for purpose-built AI tools under meaningful human control, with liability, access limits, external guardrails, and international cooperation. Lees meer
LINKS:
A Better Path for AI
What You Can Do
CHAPTERS:
(00:00) Episode Preview
(01:03) Attention, attachment, automation
(13:58) Superintelligence power race
(26:39) Escaping replacement dynamics
(40:15) Pro-human tool AI
(53:30) Guardrails and verification
(01:03:24) Defining pro-human AI
(01:10:37) Agents and accountability
(01:17:28) International AI cooperation
(01:25:28) Rethinking AI alignment
(01:32:43) Optimism and action
PRODUCED BY:
https://aipodcast.ing
SOCIAL LINKS:
Website: https://podcast.futureoflife.org
Twitter (FLI): https://x.com/FLI_org
Twitter (Gus): https://x.com/gusdocker
LinkedIn: https://www.linkedin.com/company/future-of-life-institute/
YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/
Apple: https://geo.itunes.apple.com/us/podcast/id1170991978
Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP
-
How to Govern AI When You Can't Predict the Future (with Charlie Bullock)
7 mei 2026 · 1 uur 7 min
Charlie Bullock is a Senior Research Fellow at the Institute for Law and AI. He joins the podcast to discuss radical optionality: how governments can prepare for very advanced AI without locking in premature rules. The conversation covers why law often trails technology, and how transparency, reporting, evaluations, cybersecurity standards, and expanded technical hiring could help. We also discuss private oversight, state versus federal rules, and the risk of concentrating power in companies or government. Lees meer
LINKS:
Radical Optionality website
Charlie Bullock
CHAPTERS:
(00:00) Episode Preview
(01:04) The pacing problem
(06:18) Defining radical optionality
(11:03) Assumptions under uncertainty
(16:00) Industry convenience concerns
(20:41) Political will realities
(26:48) Private governance limits
(30:28) Government misuse risks
(36:29) Balancing institutional power
(42:25) Transparency and reporting
(49:35) Evaluations, security, talent
(58:26) State law preemption
(01:04:20) Historical nuclear analogies
PRODUCED BY:
https://aipodcast.ing
SOCIAL LINKS:
Website: https://podcast.futureoflife.org
Twitter (FLI): https://x.com/FLI_org
Twitter (Gus): https://x.com/gusdocker
LinkedIn: https://www.linkedin.com/company/future-of-life-institute/
YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/
Apple: https://geo.itunes.apple.com/us/podcast/id1170991978
Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP
-
Why AI Is Not a Normal Technology (with Peter Wildeford)
29 april 2026 · 1 uur 24 min
Peter Wildeford is Head of Policy at the AI Policy Network, and a top AI forecaster. He joins the podcast to discuss how to forecast AI progress and what current trends imply for the economy and national security. Peter argues AI is neither a bubble nor a normal technology, and we examine benchmark trends, adoption lags, unemployment and productivity effects, and the rise of cyber capabilities. We also cover robotics, export controls, prediction markets, and when AI may surpass human forecasters. Lees meer
LINKS:
Peter Wildeford Blog
CHAPTERS:
(00:00) Episode Preview
(01:12) AI bubble debate
(06:25) Normal technology question
(15:31) Mythos security implications
(30:47) Robotics and labor
(40:27) Social economic response
(48:57) Forecasting methodology
(59:49) AGI policy timelines
(01:11:13) Forecasting with AI
PRODUCED BY:
https://aipodcast.ing
SOCIAL LINKS:
Website: https://podcast.futureoflife.org
Twitter (FLI): https://x.com/FLI_org
Twitter (Gus): https://x.com/gusdocker
LinkedIn: https://www.linkedin.com/company/future-of-life-institute/
YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/
Apple: https://geo.itunes.apple.com/us/podcast/id1170991978
Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP
-
Why AI Evaluation Science Can't Keep Up (with Carina Prunkl)
17 april 2026 · 54 min
Carina Prunkl is a researcher at Inria. She joins the podcast to discuss how to assess the capabilities and risks of general-purpose AI. We examine why systems can solve hard coding and math problems yet still fail at simple tasks, why pre-deployment tests often miss real-world behavior, and how faster capability gains can increase misuse risks. The conversation also covers de-skilling, red teaming, layered safeguards, and warning signs that AIs might undermine oversight. Lees meer
LINKS:
Carina Prunkl personal website
CHAPTERS:
(00:00) Episode Preview
(01:04) Introducing the report
(02:10) Jagged frontier capabilities
(05:29) Formal reasoning progress
(12:36) Risks and evaluation science
(19:00) Funding evaluation capacity
(24:03) Autonomy and de-skilling
(31:32) Authenticity and AI companions
(41:00) Defense in depth methods
(48:34) Loss of control risks
(53:16) Where to read report
PRODUCED BY:
https://aipodcast.ing
SOCIAL LINKS:
Website: https://podcast.futureoflife.org
Twitter (FLI): https://x.com/FLI_org
Twitter (Gus): https://x.com/gusdocker
LinkedIn: https://www.linkedin.com/company/future-of-life-institute/
YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/
Apple: https://geo.itunes.apple.com/us/podcast/id1170991978
Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP
-
Defense in Depth: Layered Strategies Against AI Risk (with Li-Lian Ang)
2 april 2026 · 56 min
Li-Lian Ang is a team member at Blue Dot Impact. She joins the podcast to discuss how society can build a workforce to protect humanity from AI risks. The conversation covers engineered pandemics, AI-enabled cyber attacks, job loss and disempowerment, and power concentration in firms or AI systems. We also examine Blue Dot's defense-in-depth framework and how individuals can navigate rapid, uncertain AI progress. Lees meer
LINKS:
Li-Lian Ang personal site
Blue Dot Impact organization site
CHAPTERS:
(00:00) Episode Preview
(00:48) Blue dot beginnings
(03:04) Evolving AI risk concerns
(06:20) AI agents in cyber
(15:52) Gradual disempowerment and jobs
(23:26) Aligning AI with humans
(29:08) Power concentration and misuse
(34:52) Influencing frontier AI labs
(43:05) Uncertain timelines and strategy
(50:18) Writing, AI, and action
PRODUCED BY:
https://aipodcast.ing
SOCIAL LINKS:
Website: https://podcast.futureoflife.org
Twitter (FLI): https://x.com/FLI_org
Twitter (Gus): https://x.com/gusdocker
LinkedIn: https://www.linkedin.com/company/future-of-life-institute/
YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/
Apple: https://geo.itunes.apple.com/us/podcast/id1170991978
Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP
-
What AI Companies Get Wrong About Curing Cancer (with Emilia Javorsky)
20 maart 2026 · 1 uur 12 min
Emilia Javorsky is a physician-scientist and Director of the Futures Program at the Future of Life Institute. Lees meer
She joins the podcast to discuss her newly published essay on AI and cancer. She challenges tech claims that superintelligence will cure cancer, explaining why biology’s complexity, poor data, and misaligned incentives are bigger bottlenecks than raw intelligence. The conversation covers realistic roles for AI in drug discovery, clinical trials, and cutting unnecessary medical bureaucracy.
You can read the full essay at: curecancer.ai
CHAPTERS:
(00:00) Episode Preview
(01:10) Introduction and essay motivation
(06:30) Intelligence vs data bottlenecks
(19:03) Cancer's complexity and heterogeneity
(29:05) Measurement, health, and homeostasis
(41:41) AI in drug development
(50:13) Regulation, FDA, and innovation
(01:02:58) Practical paths toward cures
PRODUCED BY:
https://aipodcast.ing
SOCIAL LINKS:
Website: https://podcast.futureoflife.org
Twitter (FLI): https://x.com/FLI_org
Twitter (Gus): https://x.com/gusdocker
LinkedIn: https://www.linkedin.com/company/future-of-life-institute/
YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/
Apple: https://geo.itunes.apple.com/us/podcast/id1170991978
Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP
-
AI vs Cancer - How AI Can, and Can't, Cure Cancer (by Emilia Javorsky)
16 maart 2026 · 2 uur 43 min
Tech executives have promised that AI will cure cancer. The reality is more complicated — and more hopeful. This essay examines where AI genuinely accelerates cancer research, where the promises fall short, and what researchers, policymakers, and funders need to do next. Lees meer
You can read the full essay at: curecancer.ai
CHAPTERS:
(00:00) Essay Preview
(00:54) How AI Can, and Can't, Cure Cancer
(17:05) Reckoning with Past Failures
(35:23) Misguiding Myths and Errors
(59:15) AI Solutions Derive from First Principles or Data
(01:31:31) Systemic Bottlenecks & Misalignments
(02:08:46) Conclusion
(02:14:35) The Roadmap Forward
PRODUCED BY:
https://aipodcast.ing
SOCIAL LINKS:
Website: https://podcast.futureoflife.org
Twitter (FLI): https://x.com/FLI_org
Twitter (Gus): https://x.com/gusdocker
LinkedIn: https://www.linkedin.com/company/future-of-life-institute/
YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/
Apple: https://geo.itunes.apple.com/us/podcast/id1170991978
Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP
-
How AI Hacks Your Brain's Attachment System (with Zak Stein)
5 maart 2026 · 1 uur 45 min
Zak Stein is a researcher focused on child development, education, and existential risk. He joins the podcast to discuss the psychological harms of anthropomorphic AI. We examine attention and attachment hacking, AI companions for kids, loneliness, and cognitive atrophy. Our conversation also covers how we can preserve human relationships, redesign education, and build cognitive security tools that keep AI from undermining our humanity. Lees meer
LINKS:
AI Psychological Harms Research Coalition
Zak Stein official website
CHAPTERS:
(00:00) Episode Preview
(00:56) Education to existential risk
(03:03) Lessons from social media
(08:41) Attachment systems and AI
(18:42) AI companions and attachment
(27:23) Anthropomorphism and user disempowerment
(36:06) Cognitive atrophy and tools
(45:54) Children, toys, and attachment
(57:38) AI psychosis and selfhood
(01:10:31) Cognitive security and parenting
(01:26:15) Education, collapse, and speciation
(01:36:40) Preserving humanity and values
PRODUCED BY:
https://aipodcast.ing
SOCIAL LINKS:
Website: https://podcast.futureoflife.org
Twitter (FLI): https://x.com/FLI_org
Twitter (Gus): https://x.com/gusdocker
LinkedIn: https://www.linkedin.com/company/future-of-life-institute/
YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/
Apple: https://geo.itunes.apple.com/us/podcast/id1170991978
Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP
-
The Case for a Global Ban on Superintelligence (with Andrea Miotti)
20 februari 2026 · 1 uur 7 min
Andrea Miotti is the founder and CEO of Control AI, a nonprofit. He joins the podcast to discuss efforts to prevent extreme risks from superintelligent AI. The conversation covers industry lobbying, comparisons with tobacco regulation, and why he advocates a global ban on AI systems that can outsmart and overpower humans. We also discuss informing lawmakers and the public, and concrete actions listeners can take. Lees meer
LINKS:
Control AI
Control AI global action page
ControlAI's lawmaker contact tools
Open roles at ControlAI
ControlAI's theory of change
CHAPTERS:
(00:00) Episode Preview
(00:52) Extinction risk and lobbying
(08:59) Progress toward superintelligence
(16:26) Building political awareness
(24:27) Global regulation strategy
(33:06) Race dynamics and public
(42:36) Vision and key safeguards
(51:18) Recursive self-improvement controls
(58:13) Power concentration and action
PRODUCED BY:
https://aipodcast.ing
SOCIAL LINKS:
Website: https://podcast.futureoflife.org
Twitter (FLI): https://x.com/FLI_org
Twitter (Gus): https://x.com/gusdocker
LinkedIn: https://www.linkedin.com/company/future-of-life-institute/
YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/
Apple: https://geo.itunes.apple.com/us/podcast/id1170991978
Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP
-
Can AI Do Our Alignment Homework? (with Ryan Kidd)
6 februari 2026 · 1 uur 47 min
Ryan Kidd is a co-executive director at MATS. This episode is a cross-post from "The Cognitive Revolution", hosted by Nathan Labenz. In this conversation, they discuss AGI timelines, model deception risks, and whether safety work can avoid boosting capabilities. Ryan outlines MATS research tracks, key researcher archetypes, hiring needs, and advice for applicants considering a career in AI safety. Learn more about Ryan's work and MATS at: https://matsprogram.org Lees meer
CHAPTERS:
(00:00) Episode Preview
(00:20) Introductions and AGI timelines
(10:13) Deception, values, and control
(23:20) Dual use and alignment
(32:22) Frontier labs and governance
(44:12) MATS tracks and mentors
(58:14) Talent archetypes and demand
(01:12:30) Applicant profiles and selection
(01:20:04) Applications, breadth, and growth
(01:29:44) Careers, resources, and ideas
(01:45:49) Final thanks and wrap
PRODUCED BY:
https://aipodcast.ing
SOCIAL LINKS:
Website: https://podcast.futureoflife.org
Twitter (FLI): https://x.com/FLI_org
Twitter (Gus): https://x.com/gusdocker
LinkedIn: https://www.linkedin.com/company/future-of-life-institute/
YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/
Apple: https://geo.itunes.apple.com/us/podcast/id1170991978
Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP
-
How to Rebuild the Social Contract After AGI (with Deric Cheng)
27 januari 2026 · 1 uur 5 min
Deric Cheng is Director of Research at the Windfall Trust. He joins the podcast to discuss how AI could reshape the social contract and global economy. The conversation examines labor displacement, superstar firms, and extreme wealth concentration, and asks how policy can keep workers empowered. We discuss resilient job types, new tax and welfare systems, global coordination, and a long-term vision where economic security is decoupled from work. Lees meer
LINKS:
Deric Cheng personal website
AGI Social Contract project site
Guiding society through the AI economic transition
CHAPTERS:
(00:00) Episode Preview
(01:01) Introducing Derek and AGI
(04:09) Automation, power, and inequality
(08:55) Inequality, unrest, and time
(13:46) Bridging futurists and economists
(20:35) Future of work scenarios
(27:22) Jobs resisting AI automation
(36:57) Luxury, land, and inequality
(43:32) Designing and testing solutions
(51:23) Taxation in an AI economy
(59:10) Envisioning a post-AGI society
PRODUCED BY:
https://aipodcast.ing
SOCIAL LINKS:
Website: https://podcast.futureoflife.org
Twitter (FLI): https://x.com/FLI_org
Twitter (Gus): https://x.com/gusdocker
LinkedIn: https://www.linkedin.com/company/future-of-life-institute/
YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/
Apple: https://geo.itunes.apple.com/us/podcast/id1170991978
Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP
-
How AI Can Help Humanity Reason Better (with Oly Sourbut)
20 januari 2026 · 1 uur 18 min
Oly Sourbut is a researcher at the Future of Life Foundation. He joins the podcast to discuss AI for human reasoning. We examine tools that use AI to strengthen human judgment, from collective fact-checking and scenario planning to standards for honest AI reasoning and better coordination. We also discuss how we can keep humans central as AI scales, and what it would take to build trustworthy, society-wide sensemaking. Lees meer
LINKS:
FLF organization site
Oly Sourbut personal site
CHAPTERS:
(00:00) Episode Preview
(01:03) FLF and human reasoning
(08:21) Agents and epistemic virtues
(22:16) Human use and atrophy
(35:41) Abstraction and legible AI
(47:03) Demand, trust and Wikipedia
(57:21) Map of human reasoning
(01:04:30) Negotiation, institutions and vision
(01:15:42) How to get involved
PRODUCED BY:
https://aipodcast.ing
SOCIAL LINKS:
Website: https://podcast.futureoflife.org
Twitter (FLI): https://x.com/FLI_org
Twitter (Gus): https://x.com/gusdocker
LinkedIn: https://www.linkedin.com/company/future-of-life-institute/
YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/
Apple: https://geo.itunes.apple.com/us/podcast/id1170991978
Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP
-
How to Avoid Two AI Catastrophes: Domination and Chaos (with Nora Ammann)
7 januari 2026 · 1 uur 20 min
Nora Ammann is a technical specialist at the Advanced Research and Invention Agency in the UK. She joins the podcast to discuss how to steer a slow AI takeoff toward resilient and cooperative futures. We examine risks of rogue AI and runaway competition, and how scalable oversight, formal guarantees and secure code could support AI-enabled R&D and critical infrastructure. Nora also explains AI-supported bargaining and public goods for stability. Lees meer
LINKS:
Nora Ammann site
ARIA safeguarded AI program page
AI Resilience official site
Gradual Disempowerment website
CHAPTERS:
(00:00) Episode Preview
(01:00) Slow takeoff expectations
(08:13) Domination versus chaos
(17:18) Human-AI coalitions vision
(28:14) Scaling oversight and agents
(38:45) Formal specs and guarantees
(51:10) Resilience in AI era
(01:02:21) Defense-favored cyber systems
(01:10:37) AI-enabled bargaining and trade
PRODUCED BY:
https://aipodcast.ing
SOCIAL LINKS:
Website: https://podcast.futureoflife.org
Twitter (FLI): https://x.com/FLI_org
Twitter (Gus): https://x.com/gusdocker
LinkedIn: https://www.linkedin.com/company/future-of-life-institute/
YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/
Apple: https://geo.itunes.apple.com/us/podcast/id1170991978
Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP
-
How Humans Could Lose Power Without an AI Takeover (with David Duvenaud)
23 december 2025 · 1 uur 19 min
David Duvenaud is an associate professor of computer science and statistics at the University of Toronto. He joins the podcast to discuss gradual disempowerment in a post-AGI world. We ask how humans could lose economic and political leverage without a sudden takeover, including how property rights could erode. Duvenaud describes how growth incentives shape culture, why aligning AI to humanity may become unpopular, and what better forecasting and governance might require. Lees meer
LINKS:
David Duvenaud academic homepage
Gradual Disempowerment
The Post-AGI Workshop
Post-AGI Studies Discord
CHAPTERS:
(00:00) Episode Preview
(01:05) Introducing gradual disempowerment
(06:06) Obsolete labor and UBI
(14:29) Property, power, and control
(23:38) Culture shifts toward AIs
(34:34) States misalign without people
(44:15) Competition and preservation tradeoffs
(53:03) Building post-AGI studies
(01:02:29) Forecasting and coordination tools
(01:10:26) Human values and futures
PRODUCED BY:
https://aipodcast.ing
SOCIAL LINKS:
Website: https://podcast.futureoflife.org
Twitter (FLI): https://x.com/FLI_org
Twitter (Gus): https://x.com/gusdocker
LinkedIn: https://www.linkedin.com/company/future-of-life-institute/
YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/
Apple: https://geo.itunes.apple.com/us/podcast/id1170991978
Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP
-
Why the AI Race Undermines Safety (with Steven Adler)
12 december 2025 · 1 uur 29 min
Stephen Adler is a former safety researcher at OpenAI. He joins the podcast to discuss how to govern increasingly capable AI systems. The conversation covers competitive races between AI companies, limits of current testing and alignment, mental health harms from chatbots, economic shifts from AI labor, and what international rules and audits might be needed before training superintelligent models. Lees meer
LINKS:
Steven Adler's Substack: https://stevenadler.substack.com
CHAPTERS:
(00:00) Episode Preview
(01:00) Race Dynamics And Safety
(18:03) Chatbots And Mental Health
(30:42) Models Outsmart Safety Tests
(41:01) AI Swarms And Work
(54:21) Human Bottlenecks And Oversight
(01:06:23) Animals And Superintelligence
(01:19:24) Safety Capabilities And GovernancePRODUCED BY:
https://aipodcast.ing
SOCIAL LINKS:
Website: https://podcast.futureoflife.org
Twitter (FLI): https://x.com/FLI_org
Twitter (Gus): https://x.com/gusdocker
LinkedIn: https://www.linkedin.com/company/future-of-life-institute/
YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/
Apple: https://geo.itunes.apple.com/us/podcast/id1170991978
Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP
-
Why OpenAI Is Trying to Silence Its Critics (with Tyler Johnston)
27 november 2025 · 1 uur 1 min
Tyler Johnston is Executive Director of the Midas Project. He joins the podcast to discuss AI transparency and accountability. We explore applying animal rights watchdog tactics to AI companies, the OpenAI Files investigation, and OpenAI's subpoenas against nonprofit critics. Tyler discusses why transparency is crucial when technical safety solutions remain elusive and how public pressure can effectively challenge much larger companies. Lees meer
LINKS:
The Midas Project Website
Tyler Johnston's LinkedIn Profile
CHAPTERS:
(00:00) Episode Preview
(01:06) Introducing the Midas Project
(05:01) Shining a Light on AI
(08:36) Industry Lockdown and Transparency
(13:45) The OpenAI Files
(20:55) Subpoenaed by OpenAI
(29:10) Responding to the Subpoena
(37:41) The Case for Transparency
(44:30) Pricing Risk and Regulation
(52:15) Measuring Transparency and Auditing
(57:50) Hope for the FuturePRODUCED BY:
https://aipodcast.ing
SOCIAL LINKS:
Website: https://podcast.futureoflife.org
Twitter (FLI): https://x.com/FLI_org
Twitter (Gus): https://x.com/gusdocker
LinkedIn: https://www.linkedin.com/company/future-of-life-institute/
YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/
Apple: https://geo.itunes.apple.com/us/podcast/id1170991978
Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP
-
We're Not Ready for AGI (with Will MacAskill)
14 november 2025 · 2 uur 3 min
William MacAskill is a senior research fellow at Forethought. He joins the podcast to discuss his Better Futures essay series. We explore moral error risks, AI character design, space governance, and persistent path dependence. The conversation also covers risk-averse AI systems, moral trade between value systems, and improving model specifications for ethical reasoning. Lees meer
LINKS:
- Better Futures Research Series: https://www.forethought.org/research/better-futures
- William MacAskill Forethought Profile: https://www.forethought.org/people/william-macaskillCHAPTERS:
(00:00) Episode Preview
(01:03) Improving The Future's Quality
(09:58) Moral Errors and AI Rights
(18:24) AI's Impact on Thinking
(27:17) Utopias and Population Ethics
(36:41) The Danger of Moral Lock-in
(44:38) Deals with Misaligned AI
(57:25) AI and Moral Trade
(01:08:21) Improving AI Ethical Reasoning
(01:16:05) The Risk of Path Dependence
(01:27:41) Avoiding Future Lock-in
(01:36:22) The Urgency of Space Governance
(01:46:19) A Future Research Agenda
(01:57:36) Is Intelligence a Good Bet?
PRODUCED BY:
https://aipodcast.ing
SOCIAL LINKS:
Website: https://podcast.futureoflife.org
Twitter (FLI): https://x.com/FLI_org
Twitter (Gus): https://x.com/gusdocker
LinkedIn: https://www.linkedin.com/company/future-of-life-institute/
YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/
Apple: https://geo.itunes.apple.com/us/podcast/id1170991978
Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP
-
What Happens When Insiders Sound the Alarm on AI? (with Karl Koch)
7 november 2025 · 1 uur 8 min
Karl Koch is founder of the AI Whistleblower Initiative. He joins the podcast to discuss transparency and protections for AI insiders who spot safety risks. We explore current company policies, legal gaps, how to evaluate disclosure decisions, and whistleblowing as a backstop when oversight fails. The conversation covers practical guidance for potential whistleblowers and challenges of maintaining transparency as AI development accelerates. Lees meer
LINKS:
About the AI Whistleblower Initiative
Karl Koch
PRODUCED BY:
https://aipodcast.ing
CHAPTERS:
(00:00) Episode Preview
(00:55) Starting the Whistleblower Initiative
(05:43) Current State of Protections
(13:04) Path to Optimal Policies
(23:28) A Whistleblower's First Steps
(32:29) Life After Whistleblowing
(39:24) Evaluating Company Policies
(48:19) Alternatives to Whistleblowing
(55:24) High-Stakes Future Scenarios
(01:02:27) AI and National Security
SOCIAL LINKS:
Website: https://podcast.futureoflife.org
Twitter (FLI): https://x.com/FLI_org
Twitter (Gus): https://x.com/gusdocker
LinkedIn: https://www.linkedin.com/company/future-of-life-institute/
YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/
Apple: https://geo.itunes.apple.com/us/podcast/id1170991978
Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP
DISCLAIMERS:
- AIWI does not request, encourage or counsel potential whistleblowers or listeners of this podcast to act unlawfully.
- This is not legal advice and if you, the listener, find yourself needing legal counsel, please visit https://aiwi.org/contact-hub/ for detailed profiles of the world's leading whistleblower support organizations. -
Can Machines Be Truly Creative? (with Maya Ackerman)
24 oktober 2025 · 1 uur 2 min
Maya Ackerman is an AI researcher, co-founder and CEO of WaveAI, and author of the book "Creative Machines: AI, Art & Us." She joins the podcast to discuss creativity in humans and machines. We explore defining creativity as novel and valuable output, why evolution qualifies as creative, and how AI alignment can reduce machine creativity. The conversation covers humble creative machines versus all-knowing oracles, hallucination's role in thought, and human-AI collaboration strategies that elevate rather than replace human capabilities. Lees meer
LINKS:
- Maya Ackerman: https://en.wikipedia.org/wiki/Maya_Ackerman
- Creative Machines: AI, Art & Us: https://maya-ackerman.com/creative-machines-book/PRODUCED BY:
https://aipodcast.ing
CHAPTERS:
(00:00) Episode Preview
(01:00) Defining Human Creativity
(02:58) Machine and AI Creativity
(06:25) Measuring Subjective Creativity
(10:07) Creativity in Animals
(13:43) Alignment Damages Creativity
(19:09) Creativity is Hallucination
(26:13) Humble Creative Machines
(30:50) Incentives and Replacement
(40:36) Analogies for the Future
(43:57) Collaborating with AI
(52:20) Reinforcement Learning & Slop
(55:59) AI in Education
SOCIAL LINKS:
Website: https://podcast.futureoflife.org
Twitter (FLI): https://x.com/FLI_org
Twitter (Gus): https://x.com/gusdocker
LinkedIn: https://www.linkedin.com/company/future-of-life-institute/
YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/
Apple: https://geo.itunes.apple.com/us/podcast/id1170991978
Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP
-
From Research Labs to Product Companies: AI's Transformation (with Parmy Olson)
14 oktober 2025 · 47 min
Parmy Olson is a technology columnist at Bloomberg and the author of Supremacy, which won the 2024 Financial Times Business Book of the Year. She joins the podcast to discuss the transformation of AI companies from research labs to product businesses. We explore how funding pressures have changed company missions, the role of personalities versus innovation, the challenges faced by safety teams, and power consolidation in the industry. Lees meer
LINKS:
- Parmy Olson on X (Twitter): https://x.com/parmy
- Parmy Olson’s Bloomberg columns: https://www.bloomberg.com/opinion/authors/AVYbUyZve-8/parmy-olson
- Supremacy (book): https://www.panmacmillan.com/authors/parmy-olson/supremacy/9781035038244PRODUCED BY:
https://aipodcast.ingCHAPTERS:
(00:00) Episode Preview
(01:18) Introducing Parmy Olson
(02:37) Personalities Driving AI
(06:45) From Research to Products
(12:45) Has the Mission Changed?
(19:43) The Role of Regulators
(21:44) Skepticism of AI Utopia
(28:00) The Human Cost
(33:48) Embracing Controversy
(40:51) The Role of Journalism
(41:40) Big Tech's InfluenceSOCIAL LINKS:
Website: https://podcast.futureoflife.org
Twitter (FLI): https://x.com/FLI_org
Twitter (Gus): https://x.com/gusdocker
LinkedIn: https://www.linkedin.com/company/future-of-life-institute/
YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/
Apple: https://geo.itunes.apple.com/us/podcast/id1170991978
Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP
-
Can Defense in Depth Work for AI? (with Adam Gleave)
3 oktober 2025 · 1 uur 19 min
Adam Gleave is co-founder and CEO of FAR.AI. In this cross-post from The Cognitive Revolution Podcast, he joins to discuss post-AGI scenarios and AI safety challenges. The conversation explores his three-tier framework for AI capabilities, gradual disempowerment concerns, defense-in-depth security, and research on training less deceptive models. Topics include timelines, interpretability limitations, scalable oversight techniques, and FAR.AI’s vertically integrated approach spanning technical research, policy advocacy, and field-building. Lees meer
LINKS:
Adam Gleave - https://www.gleave.me
FAR.AI - https://www.far.ai
The Cognitive Revolution Podcast - https://www.cognitiverevolution.aiPRODUCED BY:
https://aipodcast.ing
CHAPTERS:
(00:00) A Positive Post-AGI Vision
(10:07) Surviving Gradual Disempowerment
(16:34) Defining Powerful AIs
(27:02) Solving Continual Learning
(35:49) The Just-in-Time Safety Problem
(42:14) Can Defense-in-Depth Work?
(49:18) Fixing Alignment Problems
(58:03) Safer Training Formulas
(01:02:24) The Role of Interpretability
(01:09:25) FAR.AI's Vertically Integrated Approach
(01:14:14) Hiring at FAR.AI
(01:16:02) The Future of GovernanceSOCIAL LINKS:
Website: https://podcast.futureoflife.org
Twitter (FLI): https://x.com/FLI_org
Twitter (Gus): https://x.com/gusdocker
LinkedIn: https://www.linkedin.com/company/future-of-life-institute/
YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/
Apple: https://geo.itunes.apple.com/us/podcast/id1170991978
Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP
-
How We Keep Humans in Control of AI (with Beatrice Erkers)
26 september 2025 · 1 uur 7 min
Beatrice works at the Foresight Institute running their Existential Hope program. She joins the podcast to discuss the AI pathways project, which explores two alternative scenarios to the default race toward AGI. We examine tool AI, which prioritizes human oversight and democratic control, and d/acc, which emphasizes decentralized, defensive development. The conversation covers trade-offs between safety and speed, how these pathways could be combined, and what different stakeholders can do to steer toward more positive AI futures. Lees meer
LINKS:
AI Pathways - https://ai-pathways.existentialhope.com
Beatrice Erkers - https://www.existentialhope.com/team/beatrice-erkersCHAPTERS:
(00:00) Episode Preview
(01:10) Introduction and Background
(05:40) AI Pathways Project
(11:10) Defining Tool AI
(17:40) Tool AI Benefits
(23:10) D/acc Pathway Explained
(29:10) Decentralization Trade-offs
(35:10) Combining Both Pathways
(40:10) Uncertainties and Concerns
(45:10) Future Evolution
(01:01:21) Funding PilotsPRODUCED BY:
https://aipodcast.ingSOCIAL LINKS:
Website: https://podcast.futureoflife.org
Twitter (FLI): https://x.com/FLI_org
Twitter (Gus): https://x.com/gusdocker
LinkedIn: https://www.linkedin.com/company/future-of-life-institute/
YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/
Apple: https://geo.itunes.apple.com/us/podcast/id1170991978
Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP
-
Why Building Superintelligence Means Human Extinction (with Nate Soares)
18 september 2025 · 1 uur 40 min
Nate Soares is president of the Machine Intelligence Research Institute. He joins the podcast to discuss his new book "If Anyone Builds It, Everyone Dies," co-authored with Eliezer Yudkowsky. We explore why current AI systems are "grown not crafted," making them unpredictable and difficult to control. The conversation covers threshold effects in intelligence, why computer security analogies suggest AI alignment is currently nearly impossible, and why we don't get retries with superintelligence. Soares argues for an international ban on AI research toward superintelligence. Lees meer
LINKS:
If Anyone Builds It, Everyone Dies - https://ifanyonebuildsit.com
Machine Intelligence Research Institute - https://intelligence.org
Nate Soares - https://intelligence.org/team/nate-soares/PRODUCED BY:
https://aipodcast.ing
CHAPTERS:
(00:00) Episode Preview
(01:05) Introduction and Book Discussion
(03:34) Psychology of AI Alarmism
(07:52) Intelligence Threshold Effects
(11:38) Growing vs Crafting AI
(18:23) Illusion of AI Control
(26:45) Why Iteration Won't Work
(34:35) The No Retries Problem
(38:22) Computer Security Lessons
(49:13) The Cursed Problem
(59:32) Multiple Curses and Complications
(01:09:44) AI's Infrastructure Advantage
(01:16:26) Grading Humanity's Response
(01:22:55) Time Needed for Solutions
(01:32:07) International Ban Necessity
SOCIAL LINKS:
Website: https://podcast.futureoflife.org
Twitter (FLI): https://x.com/FLI_org
Twitter (Gus): https://x.com/gusdocker
LinkedIn: https://www.linkedin.com/company/future-of-life-institute/
YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/
Apple: https://geo.itunes.apple.com/us/podcast/id1170991978
Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP
-
Breaking the Intelligence Curse (with Luke Drago)
10 september 2025 · 1 uur 10 min
Luke Drago is the co-founder of Workshop Labs and co-author of the essay series "The Intelligence Curse". The essay series explores what happens if AI becomes the dominant factor of production thereby reducing incentives to invest in people. We explore pyramid replacement in firms, economic warning signs to monitor, automation barriers like tacit knowledge, privacy risks in AI training, and tensions between centralized AI safety and democratization. Luke discusses Workshop Labs' privacy-preserving approach and advises taking career risks during this technological transition. Lees meer
"The Intelligence Curse" essay series by Luke Drago & Rudolf Laine: https://intelligence-curse.ai/
Luke's Substack: https://lukedrago.substack.com/
Workshop Labs: https://workshoplabs.ai/CHAPTERS:
(00:00) Episode Preview
(00:55) Intelligence Curse Introduction
(02:55) AI vs Historical Technology
(07:22) Economic Metrics and Indicators
(11:23) Pyramid Replacement Theory
(17:28) Human Judgment and Taste
(22:25) Data Privacy and Control
(28:55) Dystopian Economic Scenario
(35:04) Resource Curse Lessons
(39:57) Culture vs Economic Forces
(47:15) Open Source AI Debate
(54:37) Corporate Mission Evolution
(59:07) AI Alignment and Loyalty
(01:05:56) Moonshots and Career Advice -
What Markets Tell Us About AI Timelines (with Basil Halperin)
1 september 2025 · 1 uur 36 min
Basil Halperin is an assistant professor of economics at the University of Virginia. He joins the podcast to discuss what economic indicators reveal about AI timelines. We explore why interest rates might rise if markets expect transformative AI, the gap between strong AI benchmarks and limited economic effects, and bottlenecks to AI-driven growth. We also cover market efficiency, automated AI research, and how financial markets may signal progress. Lees meer
Basil's essay on "Transformative AI, existential risk, and real interest rates": https://basilhalperin.com/papers/agi_emh.pdf
Read more about Basil's work here: https://basilhalperin.com/
CHAPTERS:
(00:00) Episode Preview
(00:49) Introduction and Background
(05:19) Efficient Market Hypothesis Explained
(10:34) Markets and Low Probability Events
(16:09) Information Diffusion on Wall Street
(24:34) Stock Prices vs Interest Rates
(28:47) New Goods Counter-Argument
(40:41) Why Focus on Interest Rates
(45:00) AI Secrecy and Market Efficiency
(50:52) Short Timeline Disagreements
(55:13) Wealth Concentration Effects
(01:01:55) Alternative Economic Indicators
(01:12:47) Benchmarks vs Economic Impact
(01:25:17) Open Research Questions
SOCIAL LINKS:
Website: https://future-of-life-institute-podcast.aipodcast.ing
Twitter (FLI): https://x.com/FLI_org
Twitter (Gus): https://x.com/gusdocker
LinkedIn: https://www.linkedin.com/company/future-of-life-institute/
YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/
Apple Podcasts: https://geo.itunes.apple.com/us/podcast/id1170991978
Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP
PRODUCED BY:
https://aipodcast.ing
-
AGI Security: How We Defend the Future (with Esben Kran)
22 augustus 2025 · 1 uur 18 min
Esben Kran joins the podcast to discuss why securing AGI requires more than traditional cybersecurity, exploring new attack surfaces, adaptive malware, and the societal shifts needed for resilient defenses. We cover protocols for safe agent communication, oversight without surveillance, and distributed safety models across companies and governments. Lees meer
Learn more about Esben's work at: https://blog.kran.ai
00:00 – Intro and preview
01:13 – AGI security vs traditional cybersecurity
02:36 – Rebuilding societal infrastructure for embedded security
03:33 – Sentware: adaptive, self-improving malware
04:59 – New attack surfaces
05:38 – Social media as misaligned AI
06:46 – Personal vs societal defenses
09:13 – Why private companies underinvest in security
13:01 – Security as the foundation for any AI deployment
14:15 – Oversight without a surveillance state
17:19 – Protocols for safe agent communication
20:25 – The expensive internet hypothesis
23:30 – Distributed safety for companies and governments
28:20 – Cloudflare’s “agent labyrinth” example
31:08 – Positive vision for distributed security
33:49 – Human value when labor is automated
41:19 – Encoding law for machines: contracts and enforcement
44:36 – DarkBench: detecting manipulative LLM behavior
55:22 – The AGI endgame: default path vs designed future
57:37 – Powerful tool AI
01:09:55 – Fast takeoff risk
01:16:09 – Realistic optimism
-
Reasoning, Robots, and How to Prepare for AGI (with Benjamin Todd)
15 augustus 2025 · 1 uur 27 min
Benjamin Todd joins the podcast to discuss how reasoning models changed AI, why agents may be next, where progress could stall, and what a self-improvement feedback loop in AI might mean for the economy and society. We explore concrete timelines (through 2030), compute and power bottlenecks, and the odds of an industrial explosion. We end by discussing how people can personally prepare for AGI: networks, skills, saving/investing, resilience, citizenship, and information hygiene. Lees meer
Follow Benjamin's work at: https://benjamintodd.substack.com
Timestamps:
00:00 What are reasoning models?
04:04 Reinforcement learning supercharges reasoning
05:06 Reasoning models vs. agents
10:04 Economic impact of automated math/code
12:14 Compute as a bottleneck
15:20 Shift from giant pre-training to post-training/agents
17:02 Three feedback loops: algorithms, chips, robots
20:33 How fast could an algorithmic loop run?
22:03 Chip design and production acceleration
23:42 Industrial/robotics loop and growth dynamics
29:52 Society’s slow reaction; “warning shots”
33:03 Robotics: software and hardware bottlenecks
35:05 Scaling robot production
38:12 Robots at ~$0.20/hour?
43:13 Regulation and humans-in-the-loop
49:06 Personal prep: why it still matters
52:04 Build an information network
55:01 Save more money
58:58 Land, real estate, and scarcity in an AI world
01:02:15 Valuable skills: get close to AI, or far from it
01:06:49 Fame, relationships, citizenship
01:10:01 Redistribution, welfare, and politics under AI
01:12:04 Try to become more resilient
01:14:36 Information hygiene
01:22:16 Seven-year horizon and scaling limits by ~2030
-
From Peak Horse to Peak Human: How AI Could Replace Us (with Calum Chace)
31 juli 2025 · 1 uur 37 min
On this episode, Calum Chace joins me to discuss the transformative impact of AI on employment, comparing the current wave of cognitive automation to historical technological revolutions. We talk about "universal generous income", fully-automated luxury capitalism, and redefining education with AI tutors. We end by examining verification of artificial agents and the ethics of attributing consciousness to machines. Lees meer
Learn more about Calum's work here: https://calumchace.com
Timestamps:
00:00:00 Preview and intro
00:03:02 Past tech revolutions and AI-driven unemployment
00:05:43 Cognitive automation: from secretaries to every job
00:08:02 The “peak horse” analogy and avoiding human obsolescence
00:10:55 Infinite demand and lump of labor
00:18:30 Fully-automated luxury capitalism
00:23:31 Abundance economy and a potential employment cliff
00:29:37 Education reimagined with personalized AI tutors
00:36:22 Real-world uses of LLMs: memory, drafting, emotional insight
00:42:56 Meaning beyond jobs: aristocrats, retirees, and kids
00:49:51 Four futures of superintelligence
00:57:20 Conscious AI and empathy as a safety strategy
01:10:55 Verifying AI agents
01:25:20 Over-attributing vs under-attributing machine consciousness
-
How AI Could Help Overthrow Governments (with Tom Davidson)
17 juli 2025 · 1 uur 54 min
On this episode, Tom Davidson joins me to discuss the emerging threat of AI-enabled coups, where advanced artificial intelligence could empower covert actors to seize power. We explore scenarios including secret loyalties within companies, rapid military automation, and how AI-driven democratic backsliding could differ significantly from historical precedents. Tom also outlines key mitigation strategies, risk indicators, and opportunities for individuals to help prevent these threats. Lees meer
Learn more about Tom's work here: https://www.forethought.org
Timestamps:
00:00:00 Preview: why preventing AI-enabled coups matters
00:01:24 What do we mean by an “AI-enabled coup”?
00:01:59 Capabilities AIs would need (persuasion, strategy, productivity)
00:02:36 Cyber-offense and the road to robotized militaries
00:05:32 Step-by-step example of an AI-enabled military coup
00:08:35 How AI-enabled coups would differ from historical coups
00:09:24 Democratic backsliding (Venezuela, Hungary, U.S. parallels)
00:12:38 Singular loyalties, secret loyalties, exclusive access
00:14:01 Secret-loyalty scenario: CEO with hidden control
00:18:10 From sleeper agents to sophisticated covert AIs
00:22:22 Exclusive-access threat: one project races ahead
00:29:03 Could one country outgrow the rest of the world?
00:40:00 Could a single company dominate global GDP?
00:47:01 Autocracies vs democracies
00:54:43 Mitigations for singular and secret loyalties
01:06:25 Guardrails, monitoring, and controlled-use APIs
01:12:38 Using AI itself to preserve checks-and-balances
01:24:53 Risk indicators to watch for AI-enabled coups
01:33:05 Tom’s risk estimates for the next 5 and 30 years
01:46:50 How you can help – research, policy, and careers
-
What Happens After Superintelligence? (with Anders Sandberg)
11 juli 2025 · 1 uur 45 min
Anders Sandberg joins me to discuss superintelligence and its profound implications for human psychology, markets, and governance. We talk about physical bottlenecks, tensions between the technosphere and the biosphere, and the long-term cultural and physical forces shaping civilization. We conclude with Sandberg explaining the difficulties of designing reliable AI systems amidst rapid change and coordination risks. Lees meer
Learn more about Anders's work here: https://mimircenter.org/anders-sandberg
Timestamps:
00:00:00 Preview and intro
00:04:20 2030 superintelligence scenario
00:11:55 Status, post-scarcity, and reshaping human psychology
00:16:00 Physical limits: energy, datacenter, and waste-heat bottlenecks
00:23:48 Technosphere vs biosphere
00:28:42 Culture and physics as long-run drivers of civilization
00:40:38 How superintelligence could upend markets and governments
00:50:01 State inertia: why governments lag behind companies
00:59:06 Value lock-in, censorship, and model alignment
01:08:32 Emergent AI ecosystems and coordination-failure risks
01:19:34 Predictability vs reliability: designing safe systems
01:30:32 Crossing the reliability threshold
01:38:25 Personal reflections on accelerating change
-
Why the AI Race Ends in Disaster (with Daniel Kokotajlo)
3 juli 2025 · 1 uur 10 min
On this episode, Daniel Kokotajlo joins me to discuss why artificial intelligence may surpass the transformative power of the Industrial Revolution, and just how much AI could accelerate AI research. We explore the implications of automated coding, the critical need for transparency in AI development, the prospect of AI-to-AI communication, and whether AI is an inherently risky technology. We end by discussing iterative forecasting and its role in anticipating AI's future trajectory. Lees meer
You can learn more about Daniel's work at: https://ai-2027.com and https://ai-futures.org
Timestamps:
00:00:00 Preview and intro
00:00:50 Why AI will eclipse the Industrial Revolution
00:09:48 How much can AI speed up AI research?
00:16:13 Automated coding and diffusion
00:27:37 Transparency in AI development
00:34:52 Deploying AI internally
00:40:24 Communication between AIs
00:49:23 Is AI inherently risky?
00:59:54 Iterative forecasting
-
Preparing for an AI Economy (with Daniel Susskind)
27 juni 2025 · 1 uur 4 min
On this episode, Daniel Susskind joins me to discuss disagreements between AI researchers and economists, how we can best measure AI’s economic impact, how human values can influence economic outcomes, what meaningful work will remain for humans in the future, the role of commercial incentives in AI development, and the future of education. Lees meer
You can learn more about Daniel's work here: https://www.danielsusskind.com
Timestamps:
00:00:00 Preview and intro
00:03:19 AI researchers versus economists
00:10:39 Measuring AI's economic effects
00:16:19 Can AI be steered in positive directions?
00:22:10 Human values and economic outcomes
00:28:21 What will remain for people to do?
00:44:58 Commercial incentives in AI
00:50:38 Will education move towards general skills?
00:58:46 Lessons for parents
-
Will AI Companies Respect Creators' Rights? (with Ed Newton-Rex)
20 juni 2025 · 1 uur 27 min
Ed Newton-Rex joins me to discuss the issue of AI models trained on copyrighted data, and how we might develop fairer approaches that respect human creators. We talk about AI-generated music, Ed’s decision to resign from Stability AI, the industry’s attitude towards rights, authenticity in AI-generated art, and what the future holds for creators, society, and living standards in an increasingly AI-driven world. Lees meer
Learn more about Ed's work here: https://ed.newtonrex.com
Timestamps:
00:00:00 Preview and intro
00:04:18 AI-generated music
00:12:15 Resigning from Stability AI
00:16:20 AI industry attitudes towards rights
00:26:22 Fairly Trained
00:37:16 Special kinds of training data
00:50:42 The longer-term future of AI
00:56:09 Will AI improve living standards?
01:03:10 AI versions of artists
01:13:28 Authenticity and art
01:18:45 Competitive pressures in AI
01:24:06 Priorities going forward
-
AI Timelines and Human Psychology (with Sarah Hastings-Woodhouse)
13 juni 2025 · 1 uur 16 min
On this episode, Sarah Hastings-Woodhouse joins me to discuss what benchmarks actually measure, AI’s development trajectory in comparison to other technologies, tasks that AI systems can and cannot handle, capability profiles of present and future AIs, the notion of alignment by default, and the leading AI companies’ vague AGI plans. We also discuss the human psychology of AI, including the feelings of living in the "fast world" versus the "slow world", and navigating long-term projects given short timelines. Lees meer
Timestamps:
00:00:00 Preview and intro
00:00:46 What do benchmarks measure?
00:08:08 Will AI develop like other tech?
00:14:13 Which tasks can AIs do?
00:23:00 Capability profiles of AIs
00:34:04 Timelines and social effects
00:42:01 Alignment by default?
00:50:36 Can vague AGI plans be useful?
00:54:36 The fast world and the slow world
01:08:02 Long-term projects and short timelines
-
Could Powerful AI Break Our Fragile World? (with Michael Nielsen)
6 juni 2025 · 1 uur 1 min
On this episode, Michael Nielsen joins me to discuss how humanity's growing understanding of nature poses dual-use challenges, whether existing institutions and governance frameworks can adapt to handle advanced AI safely, and how we might recognize signs of dangerous AI. We explore the distinction between AI as agents and tools, how power is latent in the world, implications of widespread powerful hardware, and finally touch upon the philosophical perspectives of deep atheism and optimistic cosmism. Lees meer
Timestamps:
00:00:00 Preview and intro
00:01:05 Understanding is dual-use
00:05:17 Can we handle AI like other tech?
00:12:08 Can institutions adapt to AI?
00:16:50 Recognizing signs of dangerous AI
00:22:45 Agents versus tools
00:25:43 Power is latent in the world
00:35:45 Widespread powerful hardware
00:42:09 Governance mechanisms for AI
00:53:55 Deep atheism and optimistic cosmism