Future of Life Institute Podcast

Alle afleveringen

281 afleveringen, van nieuw naar oud

  1. Imagine A World: What if global challenges led to more centralization?

    12 september 2023 · 1 uur

    Afspelen
    What if we had one advanced AI system for the entire world? Would this led to a world 'beyond' nation states - and do we want this? Lees meer

    Imagine a World is a podcast exploring a range of plausible and positive futures with advanced AI, produced by the Future of Life Institute. We interview the creators of 8 diverse and thought provoking imagined futures that we received as part of the worldbuilding contest FLI ran last year.

    In the third episode of Imagine A World, we explore the fictional worldbuild titled 'Core Central'.

    How does a team of seven academics agree on one cohesive imagined world? That's a question the team behind 'Core Central', a second-place prizewinner in the FLI Worldbuilding Contest, had to figure out as they went along. In the end, this entry's realistic sense of multipolarity and messiness reflect positively its organic formulation. The team settled on one core, centralised AGI system as the governance model for their entire world. This eventually moves their world 'beyond' nation states. Could this really work?

    In this third episode of 'Imagine a World',​ Guillaume Riesen speaks to two of the academics in this team, John Burden and Henry Shevlin, representing the team that created 'Core Central'. The full team includes seven members, three of whom (Henry, John and Beba Cibralic) are researchers at the Leverhulme Centre for the Future of Intelligence, University of Cambridge, and five of whom (Jessica Bland, Lara Mani, Clarissa Rios Rojas, Catherine Richards alongside John) work with the Centre for the Study of Existential Risk, also at Cambridge University.

    Please note: This episode explores the ideas created as part of FLI’s worldbuilding contest, and our hope is that this series sparks discussion about the kinds of futures we want. The ideas present in these imagined worlds and in our podcast are not to be taken as FLI endorsed positions.

    Explore this imagined world: https://worldbuild.ai/core-central

    The podcast is produced by the Future…

  2. Tom Davidson on How Quickly AI Could Automate the Economy

    8 september 2023 · 1 uur 56 min

    Afspelen
    Tom Davidson joins the podcast to discuss how AI could quickly automate most cognitive tasks, including AI research, and why this would be risky. Lees meer

    Timestamps:
    00:00 The current pace of AI
    03:58 Near-term risks from AI
    09:34 Historical analogies to AI
    13:58 AI benchmarks VS economic impact
    18:30 AI takeoff speed and bottlenecks
    31:09 Tom's model of AI takeoff speed
    36:21 How AI could automate AI research
    41:49 Bottlenecks to AI automating AI hardware
    46:15 How much of AI research is automated now?
    48:26 From 20% to 100% automation
    53:24 AI takeoff in 3 years
    1:09:15 Economic impacts of fast AI takeoff
    1:12:51 Bottlenecks slowing AI takeoff
    1:20:06 Does the market predict a fast AI takeoff?
    1:25:39 "Hard to avoid AGI by 2060"
    1:27:22 Risks from AI over the next 20 years
    1:31:43 AI progress without more compute
    1:44:01 What if AI models fail safety evaluations?
    1:45:33 Cybersecurity at AI companies
    1:47:33 Will AI turn out well for humanity?
    1:50:15 AI and board games

  3. Imagine A World: What if we designed and built AI in an inclusive way?

    5 september 2023 · 53 min

    Afspelen
    How does who is involved in the design of AI affect the possibilities for our future? Why isn’t the design of AI inclusive already? Can technology solve all our problems? Can human nature change? Do we want either of these things to happen? Lees meer

    Imagine a World is a podcast exploring a range of plausible and positive futures with advanced AI, produced by the Future of Life Institute. We interview the creators of 8 diverse and thought provoking imagined futures that we received as part of the worldbuilding contest FLI ran last year

    In this second episode of Imagine A World we explore the fictional worldbuild titled 'Crossing Points', a second place entry in FLI's worldbuilding contest.

    Joining Guillaume Riesen on the Imagine a World podcast this time are two members of the Crossing Points team, Elaine Czech and Vanessa Hanschke, both academics at the University of Bristol. Elaine has a background in art and design, and is studying the accessibility of technologies for the elderly. Vanessa is studying responsible AI practices of technologists, using methods like storytelling to promote diverse voices in AI research. Their teammates in the contest were Tashi Namgyal, a University of Bristol PhD studying the controllability of deep generative models, Dr. Susan Lechelt, who researches the applications and implications of emerging technologies at the University of Edinburgh, and Nicol Ogston, a British civil servant.

    There's an emphasis on the unanticipated impacts of new technologies on those who weren't considered during their development. From urban families in Indonesia to anti-technology extremists in America, we're shown that there's something to learn from every human story. This world emphasizes the importance of broadening our lens and empowering marginalized voices in order to build a future that would be bright for more than just a privileged few.

    The world of Crossing Points looks pretty different from our own, with advanced AIs debating philosophy on TV and …

  4. Imagine A World: What if new governance mechanisms helped us coordinate?

    5 september 2023 · 1 uur 3 min

    Afspelen
    Are today's democratic systems equipped well enough to create the best possible future for everyone? If they're not, what systems might work better? And are governments around the world taking the destabilizing threats of new technologies seriously enough, or will it take a dramatic event, such as an AI-driven war, to get their act together? Lees meer

    Imagine a World is a podcast exploring a range of plausible and positive futures with advanced AI, produced by the Future of Life Institute. We interview the creators of 8 diverse and thought provoking imagined futures that we received as part of the worldbuilding contest FLI ran last year.

    In this first episode of Imagine A World we explore the fictional worldbuild titled 'Peace Through Prophecy'.

    Host Guillaume Riesen speaks to the makers of 'Peace Through Prophecy', a second place entry in FLI's Worldbuilding Contest. The worldbuild was created by Jackson Wagner, Diana Gurvich and Holly Oatley. In the episode, Jackson and Holly discuss just a few of the many ideas bubbling around in their imagined future.

    At its core, this world is arguably about community. It asks how technology might bring us closer together, and allow us to reinvent our social systems. Many roads are explored, a whole garden of governance systems bolstered by Artificial Intelligence and other technologies. Overall, there's a shift towards more intimate and empowered communities. Even the AI systems eventually come to see their emotional and creative potentials realized. While progress is uneven, and littered with many human setbacks, a pretty good case is made for how everyone's best interests can lead us to a more positive future.

    Please note: This episode explores the ideas created as part of FLI’s Worldbuilding contest, and our hope is that this series sparks discussion about the kinds of futures we want. The ideas present in these imagined worlds and in our podcast are not to be taken as FLI endorsed positions

    Explore this imagined world: https:…

  5. New: Imagine A World Podcast [TRAILER]

    29 augustus 2023 · 2 min

    Afspelen
    Coming Soon… Lees meer

    The year is 2045. Humanity is not extinct, nor living in a dystopia. It has averted climate disaster and major wars. Instead, AI and other new technologies are helping to make the world more peaceful, happy and equal. How? This was what we asked the entrants of our Worldbuilding Contest to imagine last year.

    Our new podcast series digs deeper into the eight winning entries, their ideas and solutions, the diverse teams behind them and the challenges they faced. You might love some; others you might not choose to inhabit. FLI is not endorsing any one idea. Rather, we hope to grow the conversation about what futures people get excited about.

    Ask yourself, with each episode, is this a world you’d want to live in? And if not, what would you prefer?

    Don’t miss the first two episodes coming to your feed at the start of September!

    In the meantime, do explore the winning worlds, if you haven’t already: https://worldbuild.ai/

  6. Robert Trager on International AI Governance and Cybersecurity at AI Companies

    20 augustus 2023 · 1 uur 44 min

    Afspelen
    Robert Trager joins the podcast to discuss AI governance, the incentives of governments and companies, the track record of international regulation, the security dilemma in AI, cybersecurity at AI companies, and skepticism about AI governance. We also discuss Robert's forthcoming paper International Governance of Civilian AI: A Jurisdictional Certification Approach. You can read more about Robert's work at https://www.governance.ai Lees meer

    Timestamps:
    00:00 The goals of AI governance
    08:38 Incentives of governments and companies
    18:58 Benefits of regulatory diversity
    28:50 The track record of anticipatory regulation
    37:55 The security dilemma in AI
    46:20 Offense-defense balance in AI
    53:27 Failure rates and international agreements
    1:00:33 Verification of compliance
    1:07:50 Controlling AI supply chains
    1:13:47 Cybersecurity at AI companies
    1:21:30 The jurisdictional certification approach
    1:28:40 Objections to AI governance

  7. Jason Crawford on Progress and Risks from AI

    21 juli 2023 · 1 uur 26 min

    Afspelen
    Jason Crawford joins the podcast to discuss the history of progress, the future of economic growth, and the relationship between progress and risks from AI. You can read more about Jason's work at https://rootsofprogress.org Lees meer

    Timestamps:
    00:00 Eras of human progress
    06:47 Flywheels of progress
    17:56 Main causes of progress
    21:01 Progress and risk
    32:49 Safety as part of progress
    45:20 Slowing down specific technologies?
    52:29 Four lenses on AI risk
    58:48 Analogies causing disagreement
    1:00:54 Solutionism about AI
    1:10:43 Insurance, subsidies, and bug bounties for AI risk
    1:13:24 How is AI different from other technologies?
    1:15:54 Future scenarios of economic growth

  8. Special: Jaan Tallinn on Pausing Giant AI Experiments

    6 juli 2023 · 1 uur 41 min

    Afspelen
    On this special episode of the podcast, Jaan Tallinn talks with Nathan Labenz about Jaan's model of AI risk, the future of AI development, and pausing giant AI experiments. Lees meer

    Timestamps:
    0:00 Nathan introduces Jaan
    4:22 AI safety and Future of Life Institute
    5:55 Jaan's first meeting with Eliezer Yudkowsky
    12:04 Future of AI evolution
    14:58 Jaan's investments in AI companies
    23:06 The emerging danger paradigm
    26:53 Economic transformation with AI
    32:31 AI supervising itself
    34:06 Language models and validation
    38:49 Lack of insight into evolutionary selection process
    41:56 Current estimate for life-ending catastrophe
    44:52 Inverse scaling law
    53:03 Our luck given the softness of language models
    55:07 Future of language models
    59:43 The Moore's law of mad science
    1:01:45 GPT-5 type project
    1:07:43 The AI race dynamics
    1:09:43 AI alignment with the latest models
    1:13:14 AI research investment and safety
    1:19:43 What a six-month pause buys us
    1:25:44 AI passing the Turing Test
    1:28:16 AI safety and risk
    1:32:01 Responsible AI development.
    1:40:03 Neuralink implant technology

  9. Joe Carlsmith on How We Change Our Minds About AI Risk

    22 juni 2023 · 2 uur 24 min

    Afspelen
    Joe Carlsmith joins the podcast to discuss how we change our minds about AI risk, gut feelings versus abstract models, and what to do if transformative AI is coming soon. You can read more about Joe's work at https://joecarlsmith.com. Lees meer

    Timestamps:
    00:00 Predictable updating on AI risk
    07:27 Abstract models versus gut feelings
    22:06 How Joe began believing in AI risk
    29:06 Is AI risk falsifiable?
    35:39 Types of skepticisms about AI risk
    44:51 Are we fundamentally confused?
    53:35 Becoming alienated from ourselves?
    1:00:12 What will change people's minds?
    1:12:34 Outline of different futures
    1:20:43 Humanity losing touch with reality
    1:27:14 Can we understand AI sentience?
    1:36:31 Distinguishing real from fake sentience
    1:39:54 AI doomer epistemology
    1:45:23 AI benchmarks versus real-world AI
    1:53:00 AI improving AI research and development
    2:01:08 What if transformative AI comes soon?
    2:07:21 AI safety if transformative AI comes soon
    2:16:52 AI systems interpreting other AI systems
    2:19:38 Philosophy and transformative AI

    Social Media Links:
    ➡️ WEBSITE: https://futureoflife.org
    ➡️ TWITTER: https://twitter.com/FLIxrisk
    ➡️ INSTAGRAM: https://www.instagram.com/futureoflifeinstitute/
    ➡️ META: https://www.facebook.com/futureoflifeinstitute
    ➡️ LINKEDIN: https://www.linkedin.com/company/future-of-life-institute/

  10. Dan Hendrycks on Why Evolution Favors AIs over Humans

    8 juni 2023 · 2 uur 27 min

    Afspelen
    Dan Hendrycks joins the podcast to discuss evolutionary dynamics in AI development and how we could develop AI safely. You can read more about Dan's work at https://www.safe.ai Lees meer

    Timestamps:
    00:00 Corporate AI race
    06:28 Evolutionary dynamics in AI
    25:26 Why evolution applies to AI
    50:58 Deceptive AI
    1:06:04 Competition erodes safety
    10:17:40 Evolutionary fitness: humans versus AI
    1:26:32 Different paradigms of AI risk
    1:42:57 Interpreting AI systems
    1:58:03 Honest AI and uncertain AI
    2:06:52 Empirical and conceptual work
    2:12:16 Losing touch with reality

    Social Media Links:
    ➡️ WEBSITE: https://futureoflife.org
    ➡️ TWITTER: https://twitter.com/FLIxrisk
    ➡️ INSTAGRAM: https://www.instagram.com/futureoflifeinstitute/
    ➡️ META: https://www.facebook.com/futureoflifeinstitute
    ➡️ LINKEDIN: https://www.linkedin.com/company/future-of-life-institute/

  11. Roman Yampolskiy on Objections to AI Safety

    26 mei 2023 · 1 uur 42 min

    Afspelen
    Roman Yampolskiy joins the podcast to discuss various objections to AI safety, impossibility results for AI, and how much risk civilization should accept from emerging technologies. You can read more about Roman's work at http://cecs.louisville.edu/ry/ Lees meer

    Timestamps:
    00:00 Objections to AI safety
    15:06 Will robots make AI risks salient?
    27:51 Was early AI safety research useful?
    37:28 Impossibility results for AI
    47:25 How much risk should we accept?
    1:01:21 Exponential or S-curve?
    1:12:27 Will AI accidents increase?
    1:23:56 Will we know who was right about AI?
    1:33:33 Difference between AI output and AI model

    Social Media Links:
    ➡️ WEBSITE: https://futureoflife.org
    ➡️ TWITTER: https://twitter.com/FLIxrisk
    ➡️ INSTAGRAM: https://www.instagram.com/futureoflifeinstitute/
    ➡️ META: https://www.facebook.com/futureoflifeinstitute
    ➡️ LINKEDIN: https://www.linkedin.com/company/future-of-life-institute/

  12. Nathan Labenz on How AI Will Transform the Economy

    11 mei 2023 · 1 uur 7 min

    Afspelen
    Nathan Labenz joins the podcast to discuss the economic effects of AI on growth, productivity, and employment. We also talk about whether AI might have catastrophic effects on the world. You can read more about Nathan's work at https://www.cognitiverevolution.ai Lees meer

    Timestamps:
    00:00 Economic transformation from AI
    11:15 Productivity increases from technology
    17:44 AI effects on employment
    28:43 Life without jobs
    38:42 Losing contact with reality
    42:31 Catastrophic risks from AI
    53:52 Scaling AI training runs
    1:02:39 Stable opinions on AI?

    Social Media Links:
    ➡️ WEBSITE: https://futureoflife.org
    ➡️ TWITTER: https://twitter.com/FLIxrisk
    ➡️ INSTAGRAM: https://www.instagram.com/futureoflifeinstitute/
    ➡️ META: https://www.facebook.com/futureoflifeinstitute
    ➡️ LINKEDIN: https://www.linkedin.com/company/future-of-life-institute/

  13. Nathan Labenz on the Cognitive Revolution, Red Teaming GPT-4, and Potential Dangers of AI

    4 mei 2023 · 1 uur

    Afspelen
    Nathan Labenz joins the podcast to discuss the cognitive revolution, his experience red teaming GPT-4, and the potential near-term dangers of AI. You can read more about Nathan's work at
    https://www.cognitiverevolution.ai
    Lees meer

    Timestamps:
    00:00 The cognitive revolution
    07:47 Red teaming GPT-4
    24:00 Coming to believe in transformative AI
    30:14 Is AI depth or breadth most impressive?
    42:52 Potential near-term dangers from AI

    Social Media Links:
    ➡️ WEBSITE: https://futureoflife.org
    ➡️ TWITTER: https://twitter.com/FLIxrisk
    ➡️ INSTAGRAM: https://www.instagram.com/futureoflifeinstitute/
    ➡️ META: https://www.facebook.com/futureoflifeinstitute
    ➡️ LINKEDIN: https://www.linkedin.com/company/future-of-life-institute/

  14. Maryanna Saenko on Venture Capital, Philanthropy, and Ethical Technology

    27 april 2023 · 1 uur 18 min

    Afspelen
    Maryanna Saenko joins the podcast to discuss how venture capital works, how to fund innovation, and what the fields of investing and philanthropy could learn from each other. You can read more about Maryanna's work at https://future.ventures Lees meer

    Timestamps:
    00:00 How does venture capital work?
    09:01 Failure and success for startups
    13:22 Is overconfidence necessary?
    19:20 Repeat entrepreneurs
    24:38 Long-term investing
    30:36 Feedback loops from investments
    35:05 Timing investments
    38:35 The hardware-software dichotomy
    42:19 Innovation prizes
    45:43 VC lessons for philanthropy
    51:03 Creating new markets
    54:01 Investing versus philanthropy
    56:14 Technology preying on human frailty
    1:00:55 Are good ideas getting harder to find?
    1:06:17 Artificial intelligence
    1:12:41 Funding ethics research
    1:14:25 Is philosophy useful?

    Social Media Links:
    ➡️ WEBSITE: https://futureoflife.org
    ➡️ TWITTER: https://twitter.com/FLIxrisk
    ➡️ INSTAGRAM: https://www.instagram.com/futureoflifeinstitute/
    ➡️ META: https://www.facebook.com/futureoflifeinstitute
    ➡️ LINKEDIN: https://www.linkedin.com/company/future-of-life-institute/

  15. Connor Leahy on the State of AI and Alignment Research

    20 april 2023 · 52 min

    Afspelen
    Connor Leahy joins the podcast to discuss the state of the AI. Which labs are in front? Which alignment solutions might work? How will the public react to more capable AI? You can read more about Connor's work at https://conjecture.dev Lees meer

    Timestamps:
    00:00 Landscape of AI research labs
    10:13 Is AGI a useful term?
    13:31 AI predictions
    17:56 Reinforcement learning from human feedback
    29:53 Mechanistic interpretability
    33:37 Yudkowsky and Christiano
    41:39 Cognitive Emulations
    43:11 Public reactions to AI

    Social Media Links:
    ➡️ WEBSITE: https://futureoflife.org
    ➡️ TWITTER: https://twitter.com/FLIxrisk
    ➡️ INSTAGRAM: https://www.instagram.com/futureoflifeinstitute/
    ➡️ META: https://www.facebook.com/futureoflifeinstitute
    ➡️ LINKEDIN: https://www.linkedin.com/company/future-of-life-institute/

  16. Connor Leahy on AGI and Cognitive Emulation

    13 april 2023 · 1 uur 37 min

    Afspelen
    Connor Leahy joins the podcast to discuss GPT-4, magic, cognitive emulation, demand for human-like AI, and aligning superintelligence. You can read more about Connor's work at https://conjecture.dev Lees meer

    Timestamps:
    00:00 GPT-4
    16:35 "Magic" in machine learning
    27:43 Cognitive emulations
    38:00 Machine learning VS explainability
    48:00 Human data = human AI?
    1:00:07 Analogies for cognitive emulations
    1:26:03 Demand for human-like AI
    1:31:50 Aligning superintelligence

    Social Media Links:
    ➡️ WEBSITE: https://futureoflife.org
    ➡️ TWITTER: https://twitter.com/FLIxrisk
    ➡️ INSTAGRAM: https://www.instagram.com/futureoflifeinstitute/
    ➡️ META: https://www.facebook.com/futureoflifeinstitute
    ➡️ LINKEDIN: https://www.linkedin.com/company/future-of-life-institute/

  17. Lennart Heim on Compute Governance

    6 april 2023 · 50 min

    Afspelen
    Lennart Heim joins the podcast to discuss options for governing the compute used by AI labs and potential problems with this approach to AI safety. You can read more about Lennart's work here: https://heim.xyz/about/ Lees meer

    Timestamps:
    00:00 Introduction
    00:37 AI risk
    03:33 Why focus on compute?
    11:27 Monitoring compute
    20:30 Restricting compute
    26:54 Subsidising compute
    34:00 Compute as a bottleneck
    38:41 US and China
    42:14 Unintended consequences
    46:50 Will AI be like nuclear energy?

    Social Media Links:
    ➡️ WEBSITE: https://futureoflife.org
    ➡️ TWITTER: https://twitter.com/FLIxrisk
    ➡️ INSTAGRAM: https://www.instagram.com/futureoflifeinstitute/
    ➡️ META: https://www.facebook.com/futureoflifeinstitute
    ➡️ LINKEDIN: https://www.linkedin.com/company/future-of-life-institute/

  18. Lennart Heim on the AI Triad: Compute, Data, and Algorithms

    30 maart 2023 · 48 min

    Afspelen
    Lennart Heim joins the podcast to discuss how we can forecast AI progress by researching AI hardware. You can read more about Lennart's work here: https://heim.xyz/about/ Lees meer

    Timestamps:
    00:00 Introduction
    01:00 The AI triad
    06:26 Modern chip production
    15:54 Forecasting AI with compute
    27:18 Running out of data?
    32:37 Three eras of AI training
    37:58 Next chip paradigm
    44:21 AI takeoff speeds

    Social Media Links:
    ➡️ WEBSITE: https://futureoflife.org
    ➡️ TWITTER: https://twitter.com/FLIxrisk
    ➡️ INSTAGRAM: https://www.instagram.com/futureoflifeinstitute/
    ➡️ META: https://www.facebook.com/futureoflifeinstitute
    ➡️ LINKEDIN: https://www.linkedin.com/company/future-of-life-institute/

  19. Liv Boeree on Poker, GPT-4, and the Future of AI

    23 maart 2023 · 52 min

    Afspelen
    Liv Boeree joins the podcast to discuss poker, GPT-4, human-AI interaction, whether this is the most important century, and building a dataset of human wisdom. You can read more about Liv's work here: https://livboeree.com Lees meer

    Timestamps:
    00:00 Introduction
    00:36 AI in Poker
    09:35 Game-playing AI
    13:45 GPT-4 and generative AI
    26:41 Human-AI interaction
    32:05 AI arms race risks
    39:32 Most important century?
    42:36 Diminishing returns to intelligence?
    49:14 Dataset of human wisdom/meaning

    Social Media Links:
    ➡️ WEBSITE: https://futureoflife.org
    ➡️ TWITTER: https://twitter.com/FLIxrisk
    ➡️ INSTAGRAM: https://www.instagram.com/futureoflifeinstitute/
    ➡️ META: https://www.facebook.com/futureoflifeinstitute
    ➡️ LINKEDIN: https://www.linkedin.com/company/future-of-life-institute/

  20. Liv Boeree on Moloch, Beauty Filters, Game Theory, Institutions, and AI

    16 maart 2023 · 42 min

    Afspelen
    Liv Boeree joins the podcast to discuss Moloch, beauty filters, game theory, institutional change, and artificial intelligence. You can read more about Liv's work here: https://livboeree.com Lees meer

    Timestamps:
    00:00 Introduction
    01:57 What is Moloch?
    04:13 Beauty filters
    10:06 Science citations
    15:18 Resisting Moloch
    20:51 New institutions
    26:02 Moloch and WinWin
    28:41 Changing systems
    33:37 Artificial intelligence
    39:14 AI acceleration

    Social Media Links:
    ➡️ WEBSITE: https://futureoflife.org
    ➡️ TWITTER: https://twitter.com/FLIxrisk
    ➡️ INSTAGRAM: https://www.instagram.com/futureoflifeinstitute/
    ➡️ META: https://www.facebook.com/futureoflifeinstitute
    ➡️ LINKEDIN: https://www.linkedin.com/company/future-of-life-institute/

  21. Tobias Baumann on Space Colonization and Cooperative Artificial Intelligence

    9 maart 2023 · 43 min

    Afspelen
    Tobias Baumann joins the podcast to discuss suffering risks, space colonization, and cooperative artificial intelligence. You can read more about Tobias' work here: https://centerforreducingsuffering.org. Lees meer

    Timestamps:
    00:00 Suffering risks
    02:50 Space colonization
    10:12 Moral circle expansion
    19:14 Cooperative artificial intelligence
    36:19 Influencing governments
    39:34 Can we reduce suffering?

    Social Media Links:
    ➡️ WEBSITE: https://futureoflife.org
    ➡️ TWITTER: https://twitter.com/FLIxrisk
    ➡️ INSTAGRAM: https://www.instagram.com/futureoflifeinstitute/
    ➡️ META: https://www.facebook.com/futureoflifeinstitute
    ➡️ LINKEDIN: https://www.linkedin.com/company/future-of-life-institute/

  22. Tobias Baumann on Artificial Sentience and Reducing the Risk of Astronomical Suffering

    2 maart 2023 · 47 min

    Afspelen
    Tobias Baumann joins the podcast to discuss suffering risks, artificial sentience, and the problem of knowing which actions reduce suffering in the long-term future. You can read more about Tobias' work here: https://centerforreducingsuffering.org. Lees meer

    Timestamps:
    00:00 Introduction
    00:52 What are suffering risks?
    05:40 Artificial sentience
    17:18 Is reducing suffering hopelessly difficult?
    26:06 Can we know how to reduce suffering?
    31:17 Why are suffering risks neglected?
    37:31 How do we avoid accidentally increasing suffering?

    Social Media Links:
    ➡️ WEBSITE: https://futureoflife.org
    ➡️ TWITTER: https://twitter.com/FLIxrisk
    ➡️ INSTAGRAM: https://www.instagram.com/futureoflifeinstitute/
    ➡️ META: https://www.facebook.com/futureoflifeinstitute
    ➡️ LINKEDIN: https://www.linkedin.com/company/future-of-life-institute/

  23. Neel Nanda on Math, Tech Progress, Aging, Living up to Our Values, and Generative AI

    23 februari 2023 · 35 min

    Afspelen
    Neel Nanda joins the podcast for a lightning round on mathematics, technological progress, aging, living up to our values, and generative AI. You can find his blog here: https://www.neelnanda.io Lees meer

    Timestamps:
    00:00 Introduction
    00:55 How useful is advanced mathematics?
    02:24 Will AI replace mathematicians?
    03:28 What are the key drivers of tech progress?
    04:13 What scientific discovery would disrupt Neel's worldview?
    05:59 How should humanity view aging?
    08:03 How can we live up to our values?
    10:56 What can we learn from a person who lived 1.000 years ago?
    12:05 What should we do after we have aligned AGI?
    16:19 What important concept is often misunderstood?
    17:22 What is the most impressive scientific discovery?
    18:08 Are language models better learning tools that textbooks?
    21:22 Should settling Mars be a priority for humanity?
    22:44 How can we focus on our work?
    24:04 Are human-AI relationships morally okay?
    25:18 Are there aliens in the universe?
    26:02 What are Neel's favourite books?
    27:15 What is an overlooked positive aspect of humanity?
    28:33 Should people spend more time prepping for disaster?
    30:41 Neel's advice for teens.
    31:55 How will generative AI evolve over the next five years?
    32:56 How much can AIs achieve through a web browser?

    Social Media Links:
    ➡️ WEBSITE: https://futureoflife.org
    ➡️ TWITTER: https://twitter.com/FLIxrisk
    ➡️ INSTAGRAM: https://www.instagram.com/futureoflifeinstitute/
    ➡️ META: https://www.facebook.com/futureoflifeinstitute
    ➡️ LINKEDIN: https://www.linkedin.com/company/future-of-life-institute/

  24. Neel Nanda on Avoiding an AI Catastrophe with Mechanistic Interpretability

    16 februari 2023 · 1 uur 2 min

    Afspelen
    Neel Nanda joins the podcast to talk about mechanistic interpretability and how it can make AI safer. Neel is an independent AI safety researcher. You can find his blog here: https://www.neelnanda.io Lees meer

    Timestamps:
    00:00 Introduction
    00:46 How early is the field mechanistic interpretability?
    03:12 Why should we care about mechanistic interpretability?
    06:38 What are some successes in mechanistic interpretability?
    16:29 How promising is mechanistic interpretability?
    31:13 Is machine learning analogous to evolution?
    32:58 How does mechanistic interpretability make AI safer?
    36:54 36:54 Does mechanistic interpretability help us control AI?
    39:57 Will AI models resist interpretation?
    43:43 Is mechanistic interpretability fast enough?
    54:10 Does mechanistic interpretability give us a general understanding?
    57:44 How can you help with mechanistic interpretability?

    Social Media Links:
    ➡️ WEBSITE: https://futureoflife.org
    ➡️ TWITTER: https://twitter.com/FLIxrisk
    ➡️ INSTAGRAM: https://www.instagram.com/futureoflifeinstitute/
    ➡️ META: https://www.facebook.com/futureoflifeinstitute
    ➡️ LINKEDIN: https://www.linkedin.com/company/future-of-life-institute/

  25. Neel Nanda on What is Going on Inside Neural Networks

    9 februari 2023 · 1 uur 5 min

    Afspelen
    Neel Nanda joins the podcast to explain how we can understand neural networks using mechanistic interpretability. Neel is an independent AI safety researcher. You can find his blog here: https://www.neelnanda.io Lees meer

    Timestamps:
    00:00 Who is Neel?
    04:41 How did Neel choose to work on AI safety?
    12:57 What does an AI safety researcher do?
    15:53 How analogous are digital neural networks to brains?
    21:34 Are neural networks like alien beings?
    29:13 Can humans think like AIs?
    35:00 Can AIs help us discover new physics?
    39:56 How advanced is the field of AI safety?
    45:56 How did Neel form independent opinions on AI?
    48:20 How does AI safety research decrease the risk of extinction?

    Social Media Links:
    ➡️ WEBSITE: https://futureoflife.org
    ➡️ TWITTER: https://twitter.com/FLIxrisk
    ➡️ INSTAGRAM: https://www.instagram.com/futureoflifeinstitute/
    ➡️ META: https://www.facebook.com/futureoflifeinstitute
    ➡️ LINKEDIN: https://www.linkedin.com/company/future-of-life-institute/

  26. Connor Leahy on Aliens, Ethics, Economics, Memetics, and Education

    2 februari 2023 · 1 uur 6 min

    Afspelen
    Connor Leahy from Conjecture joins the podcast for a lightning round on a variety of topics ranging from aliens to education. Learn more about Connor's work at https://conjecture.dev Lees meer

    Social Media Links:
    ➡️ WEBSITE: https://futureoflife.org
    ➡️ TWITTER: https://twitter.com/FLIxrisk
    ➡️ INSTAGRAM: https://www.instagram.com/futureoflifeinstitute/
    ➡️ META: https://www.facebook.com/futureoflifeinstitute
    ➡️ LINKEDIN: https://www.linkedin.com/company/future-of-life-institute/

  27. Connor Leahy on AI Safety and Why the World is Fragile

    26 januari 2023 · 1 uur 5 min

    Afspelen
    Connor Leahy from Conjecture joins the podcast to discuss AI safety, the fragility of the world, slowing down AI development, regulating AI, and the optimal funding model for AI safety research. Learn more about Connor's work at https://conjecture.dev Lees meer

    Timestamps:
    00:00 Introduction
    00:47 What is the best way to understand AI safety?
    09:50 Why is the world relatively stable?
    15:18 Is the main worry human misuse of AI?
    22:47 Can humanity solve AI safety?
    30:06 Can we slow down AI development?
    37:13 How should governments regulate AI?
    41:09 How do we avoid misallocating AI safety government grants?
    51:02 Should AI safety research be done by for-profit companies?

    Social Media Links:
    ➡️ WEBSITE: https://futureoflife.org
    ➡️ TWITTER: https://twitter.com/FLIxrisk
    ➡️ INSTAGRAM: https://www.instagram.com/futureoflifeinstitute/
    ➡️ META: https://www.facebook.com/futureoflifeinstitute
    ➡️ LINKEDIN: https://www.linkedin.com/company/future-of-life-institute/

  28. Connor Leahy on AI Progress, Chimps, Memes, and Markets

    19 januari 2023 · 1 uur 4 min

    Afspelen
    Connor Leahy from Conjecture joins the podcast to discuss AI progress, chimps, memes, and markets. Learn more about Connor's work at https://conjecture.dev Lees meer

    Timestamps:
    00:00 Introduction
    01:00 Defining artificial general intelligence
    04:52 What makes humans more powerful than chimps?
    17:23 Would AIs have to be social to be intelligent?
    20:29 Importing humanity's memes into AIs
    23:07 How do we measure progress in AI?
    42:39 Gut feelings about AI progress
    47:29 Connor's predictions about AGI
    52:44 Is predicting AGI soon betting against the market?
    57:43 How accurate are prediction markets about AGI?

  29. Sean Ekins on Regulating AI Drug Discovery

    12 januari 2023 · 37 min

    Afspelen
    On this special episode of the podcast, Emilia Javorsky interviews Sean Ekins about regulating AI drug discovery. Lees meer

    Timestramps:
    00:00 Introduction
    00:31 Ethical guidelines and regulation of AI drug discovery
    06:11 How do we balance innovation and safety in AI drug discovery?
    13:12 Keeping dangerous chemical data safe
    21:16 Sean’s personal story of voicing concerns about AI drug discovery
    32:06 How Sean will continue working on AI drug discovery

  30. Sean Ekins on the Dangers of AI Drug Discovery

    5 januari 2023 · 39 min

    Afspelen
    On this special episode of the podcast, Emilia Javorsky interviews Sean Ekins about the dangers of AI drug discovery. They talk about how Sean discovered an extremely toxic chemical (VX) by reversing an AI drug discovery algorithm. Lees meer

    Timestamps:
    00:00 Introduction
    00:46 Sean’s professional journey
    03:45 Can computational models replace animal models?
    07:24 The risks of AI drug discovery
    12:48 Should scientists disclose dangerous discoveries?
    19:40 How should scientists handle dual-use technologies?
    22:08 Should we open-source potentially dangerous discoveries?
    26:20 How do we control autonomous drug creation?
    31:36 Surprising chemical discoveries made by black-box AI systems
    36:56 How could the dangers of AI drug discovery be mitigated?

  31. Anders Sandberg on the Value of the Future

    29 december 2022 · 50 min

    Afspelen
    Anders Sandberg joins the podcast to discuss various philosophical questions about the value of the future. Lees meer

    Learn more about Anders' work: https://www.fhi.ox.ac.uk

    Timestamps:
    00:00 Introduction
    00:54 Humanity as an immature teenager
    04:24 How should we respond to our values changing over time?
    18:53 How quickly should we change our values?
    24:58 Are there limits to what future morality could become?
    29:45 Could the universe contain infinite value?
    36:00 How do we balance weird philosophy with common sense?
    41:36 Lightning round: mind uploading, aliens, interstellar travel, cryonics

  32. Anders Sandberg on Grand Futures and the Limits of Physics

    22 december 2022 · 1 uur 3 min

    Afspelen
    Anders Sandberg joins the podcast to discuss how big the future could be and what humanity could achieve at the limits of physics. Lees meer

    Learn more about Anders' work: https://www.fhi.ox.ac.uk

    Timestamps:
    00:00 Introduction
    00:58 Does it make sense to write long books now?
    06:53 Is it possible to understand all of science now?
    10:44 What is exploratory engineering?
    15:48 Will humanity develop a completed science?
    21:18 How much of possible technology has humanity already invented?
    25:22 Which sciences have made the most progress?
    29:11 How materially wealthy could humanity become?
    39:34 Does a grand futures depend on space travel?
    49:16 Trade between proponents of different moral theories
    53:13 How does physics limit our ethical options?
    55:24 How much could our understanding of physics change?
    1:02:30 The next episode

  33. Anders Sandberg on ChatGPT and the Future of AI

    15 december 2022 · 58 min

    Afspelen
    Anders Sandberg from The Future of Humanity Institute joins the podcast to discuss ChatGPT, large language models, and what he's learned about the risks and benefits of AI. Lees meer

    Timestamps:
    00:00 Introduction
    00:40 ChatGPT
    06:33 Will AI continue to surprise us?
    16:22 How do language models fail?
    24:23 Language models trained on their own output
    27:29 Can language models write college-level essays?
    35:03 Do language models understand anything?
    39:59 How will AI models improve in the future?
    43:26 AI safety in light of recent AI progress
    51:28 AIs should be uncertain about values

  34. Vincent Boulanin on Military Use of Artificial Intelligence

    8 december 2022 · 48 min

    Afspelen
    Vincent Boulanin joins the podcast to explain how modern militaries use AI, including in nuclear weapons systems. Lees meer

    Learn more about Vincent's work: https://sipri.org

    Timestamps:
    00:00 Introduction
    00:45 Categorizing risks from AI and nuclear
    07:40 AI being used by non-state actors
    12:57 Combining AI with nuclear technology
    15:13 A human should remain in the loop
    25:05 Automation bias
    29:58 Information requirements for nuclear launch decisions
    35:22 Vincent's general conclusion about military machine learning
    37:22 Specific policy measures for decreasing nuclear risk

    Social Media Links:
    ➡️ WEBSITE: https://futureoflife.org
    ➡️ TWITTER: https://twitter.com/FLIxrisk
    ➡️ INSTAGRAM: https://www.instagram.com/futureoflifeinstitute/
    ➡️ META: https://www.facebook.com/futureoflifeinstitute
    ➡️ LINKEDIN: https://www.linkedin.com/company/future-of-life-institute/

  35. Vincent Boulanin on the Dangers of AI in Nuclear Weapons Systems

    1 december 2022 · 45 min

    Afspelen
    Vincent Boulanin joins the podcast to explain the dangers of incorporating artificial intelligence in nuclear weapons systems. Lees meer

    Learn more about Vincent's work: https://sipri.org

    Timestamps:
    00:00 Introduction
    00:55 What is strategic stability?
    02:45 How can AI be a positive factor in nuclear risk?
    10:17 Remote sensing of nuclear submarines
    19:50 Using AI in nuclear command and control
    24:21 How does AI change the game theory of nuclear war?
    30:49 How could AI cause an accidental nuclear escalation?
    36:57 How could AI cause an inadvertent nuclear escalation?
    43:08 What is the most important problem in AI nuclear risk?
    44:39 The next episode

  36. Robin Hanson on Predicting the Future of Artificial Intelligence

    24 november 2022 · 52 min

    Afspelen
    Robin Hanson joins the podcast to discuss AI forecasting methods and metrics. Lees meer

    Timestamps:
    00:00 Introduction
    00:49 Robin's experience working with AI
    06:04 Robin's views on AI development
    10:41 Should we care about metrics for AI progress?
    16:56 Is it useful to track AI progress?
    22:02 When should we begin worrying about AI safety?
    29:16 The history of AI development
    39:52 AI progress that deviates from current trends
    43:34 Is this AI boom different than past booms?
    48:26 Different metrics for predicting AI

  37. Robin Hanson on Grabby Aliens and When Humanity Will Meet Them

    17 november 2022 · 1 uur

    Afspelen
    Robin Hanson joins the podcast to explain his theory of grabby aliens and its implications for the future of humanity. Lees meer

    Learn more about the theory here: https://grabbyaliens.com

    Timestamps:
    00:00 Introduction
    00:49 Why should we care about aliens?
    05:58 Loud alien civilizations and quiet alien civilizations
    08:16 Why would some alien civilizations be quiet?
    14:50 The moving parts of the grabby aliens model
    23:57 Why is humanity early in the universe?
    28:46 Could't we just be alone in the universe?
    33:15 When will humanity expand into space?
    46:05 Will humanity be more advanced than the aliens we meet?
    49:32 What if we discovered aliens tomorrow?
    53:44 Should the way we think about aliens change our actions?
    57:48 Can we reasonably theorize about aliens?
    53:39 The next episode

  38. Ajeya Cotra on Thinking Clearly in a Rapidly Changing World

    10 november 2022 · 45 min

    Afspelen
    Ajeya Cotra joins us to talk about thinking clearly in a rapidly changing world. Lees meer

    Learn more about the work of Ajeya and her colleagues: https://www.openphilanthropy.org

    Timestamps:
    00:00 Introduction
    00:44 The default versus the accelerating picture of the future
    04:25 The role of AI in accelerating change
    06:48 Extrapolating economic growth
    08:53 How do we know whether the pace of change is accelerating?
    15:07 How can we cope with a rapidly changing world?
    18:50 How could the future be utopian?
    22:03 Is accelerating technological progress immoral?
    25:43 Should we imagine concrete future scenarios?
    31:15 How should we act in an accelerating world?
    34:41 How Ajeya could be wrong about the future
    41:41 What if change accelerates very rapidly?

  39. Ajeya Cotra on how Artificial Intelligence Could Cause Catastrophe

    3 november 2022 · 54 min

    Afspelen
    Ajeya Cotra joins us to discuss how artificial intelligence could cause catastrophe. Lees meer

    Follow the work of Ajeya and her colleagues: https://www.openphilanthropy.org

    Timestamps:
    00:00 Introduction
    00:53 AI safety research in general
    02:04 Realistic scenarios for AI catastrophes
    06:51 A dangerous AI model developed in the near future
    09:10 Assumptions behind dangerous AI development
    14:45 Can AIs learn long-term planning?
    18:09 Can AIs understand human psychology?
    22:32 Training an AI model with naive safety features
    24:06 Can AIs be deceptive?
    31:07 What happens after deploying an unsafe AI system?
    44:03 What can we do to prevent an AI catastrophe?
    53:58 The next episode

  40. Ajeya Cotra on Forecasting Transformative Artificial Intelligence

    27 oktober 2022 · 48 min

    Afspelen
    Ajeya Cotra joins us to discuss forecasting transformative artificial intelligence. Lees meer

    Follow the work of Ajeya and her colleagues: https://www.openphilanthropy.org

    Timestamps:
    00:00 Introduction
    00:53 Ajeya's report on AI
    01:16 What is transformative AI?
    02:09 Forecasting transformative AI
    02:53 Historical growth rates
    05:10 Simpler forecasting methods
    09:01 Biological anchors
    16:31 Different paths to transformative AI
    17:55 Which year will we get transformative AI?
    25:54 Expert opinion on transformative AI
    30:08 Are today's machine learning techniques enough?
    33:06 Will AI be limited by the physical world and regulation?
    38:15 Will AI be limited by training data?
    41:48 Are there human abilities that AIs cannot learn?
    47:22 The next episode

  41. Alan Robock on Nuclear Winter, Famine, and Geoengineering

    20 oktober 2022 · 41 min

    Afspelen
    Alan Robock joins us to discuss nuclear winter, famine and geoengineering. Lees meer

    Learn more about Alan's work: http://people.envsci.rutgers.edu/robock/

    Follow Alan on Twitter: https://twitter.com/AlanRobock

    Timestamps:
    00:00 Introduction
    00:45 What is nuclear winter?
    06:27 A nuclear war between India and Pakistan
    09:16 Targets in a nuclear war
    11:08 Why does the world have so many nuclear weapons?
    19:28 Societal collapse in a nuclear winter
    22:45 Should we prepare for a nuclear winter?
    28:13 Skepticism about nuclear winter
    35:16 Unanswered questions about nuclear winter

  42. Brian Toon on Nuclear Winter, Asteroids, Volcanoes, and the Future of Humanity

    13 oktober 2022 · 49 min

    Afspelen
    Brian Toon joins us to discuss the risk of nuclear winter. Lees meer

    Learn more about Brian's work: https://lasp.colorado.edu/home/people/brian-toon/

    Read Brian's publications: https://airbornescience.nasa.gov/person/Brian_Toon

    Timestamps:
    00:00 Introduction
    01:02 Asteroid impacts
    04:20 The discovery of nuclear winter
    13:56 Comparing volcanoes and asteroids to nuclear weapons
    19:42 How did life survive the asteroid impact 65 million years ago?
    25:05 How humanity could go extinct
    29:46 Nuclear weapons as a great filter
    34:32 Nuclear winter and food production
    40:58 The psychology of nuclear threat
    43:56 Geoengineering to prevent nuclear winter
    46:49 Will humanity avoid nuclear winter?

  43. Philip Reiner on Nuclear Command, Control, and Communications

    6 oktober 2022 · 47 min

    Afspelen
    Philip Reiner joins us to talk about nuclear, command, control and communications systems. Lees meer

    Learn more about Philip’s work: https://securityandtechnology.org/

    Timestamps:
    [00:00:00] Introduction
    [00:00:50] Nuclear command, control, and communications
    [00:03:52] Old technology in nuclear systems
    [00:12:18] Incentives for nuclear states
    [00:15:04] Selectively enhancing security
    [00:17:34] Unilateral de-escalation
    [00:18:04] Nuclear communications
    [00:24:08] The CATALINK System
    [00:31:25] AI in nuclear command, control, and communications
    [00:40:27] Russia's war in Ukraine

  44. Daniela and Dario Amodei on Anthropic

    5 maart 2022 · 2 uur 1 min

    Afspelen
    Daniela and Dario Amodei join us to discuss Anthropic: a new AI safety and research company that's working to build reliable, interpretable, and steerable AI systems. Lees meer

    Topics discussed in this episode include:

    -Anthropic's mission and research strategy
    -Recent research and papers by Anthropic
    -Anthropic's structure as a "public benefit corporation"
    -Career opportunities

    You can find the page for the podcast here: https://futureoflife.org/2022/03/04/daniela-and-dario-amodei-on-anthropic/

    Watch the video version of this episode here: https://www.youtube.com/watch?v=uAA6PZkek4A

    Careers at Anthropic: https://www.anthropic.com/#careers

    Anthropic's Transformer Circuits research: https://transformer-circuits.pub/

    Follow Anthropic on Twitter: https://twitter.com/AnthropicAI

    microCOVID Project: https://www.microcovid.org/

    Follow Lucas on Twitter: https://twitter.com/lucasfmperry

    Have any feedback about the podcast? You can share your thoughts here:
    www.surveymonkey.com/r/DRBFZCT

    Timestamps:

    0:00 Intro
    2:44 What was the intention behind forming Anthropic?
    6:28 Do the founders of Anthropic share a similar view on AI?
    7:55 What is Anthropic's focused research bet?
    11:10 Does AI existential safety fit into Anthropic's work and thinking?
    14:14 Examples of AI models today that have properties relevant to future AI existential safety
    16:12 Why work on large scale models?
    20:02 What does it mean for a model to lie?
    22:44 Safety concerns around the open-endedness of large models
    29:01 How does safety work fit into race dynamics to more and more powerful AI?
    36:16 Anthropic's mission and how it fits into AI alignment
    38:40 Why explore large models for AI safety and scaling to more intelligent systems?
    43:24 Is Anthropic's research strategy a form of prosaic alignment?
    46:22 Anthropic's recent research and papers
    49:52 How difficult is it to interpret current AI models?
    52:40 Anthropic's research on alignment and societal impact
    55:35 Why did you decide to release tools and…

  45. Anthony Aguirre and Anna Yelizarova on FLI's Worldbuilding Contest

    9 februari 2022 · 33 min

    Afspelen
    Anthony Aguirre and Anna Yelizarova join us to discuss FLI's new Worldbuilding Contest. Lees meer

    Topics discussed in this episode include:

    -Motivations behind the contest
    -The importance of worldbuilding
    -The rules of the contest
    -What a submission consists of
    -Due date and prizes

    Learn more about the contest here: https://worldbuild.ai/

    Join the discord: https://discord.com/invite/njZyTJpwMz

    You can find the page for the podcast here: https://futureoflife.org/2022/02/08/anthony-aguirre-and-anna-yelizarova-on-flis-worldbuilding-contest/

    Watch the video version of this episode here: https://www.youtube.com/watch?v=WZBXSiyienI

    Follow Lucas on Twitter here: twitter.com/lucasfmperry

    Have any feedback about the podcast? You can share your thoughts here:
    www.surveymonkey.com/r/DRBFZCT

    Timestamps:

    0:00 Intro
    2:30 What is "worldbuilding" and FLI's Worldbuilding Contest?
    6:32 Why do worldbuilding for 2045?
    7:22 Why is it important to practice worldbuilding?
    13:50 What are the rules of the contest?
    19:53 What does a submission consist of?
    22:16 Due dates and prizes?
    25:58 Final thoughts and how the contest contributes to creating beneficial futures

    This podcast is possible because of the support of listeners like you. If you found this conversation to be meaningful or valuable, consider supporting it directly by donating at futureoflife.org/donate. Contributions like yours make these conversations possible.

  46. David Chalmers on Reality+: Virtual Worlds and the Problems of Philosophy

    26 januari 2022 · 1 uur 43 min

    Afspelen
    David Chalmers, Professor of Philosophy and Neural Science at NYU, joins us to discuss his newest book Reality+: Virtual Worlds and the Problems of Philosophy. Lees meer

    Topics discussed in this episode include:

    -Virtual reality as genuine reality
    -Why VR is compatible with the good life
    -Why we can never know whether we're in a simulation
    -Consciousness in virtual realities
    -The ethics of simulated beings

    You can find the page for the podcast here: https://futureoflife.org/2022/01/26/david-chalmers-on-reality-virtual-worlds-and-the-problems-of-philosophy/

    Watch the video version of this episode here: https://www.youtube.com/watch?v=hePEg_h90KI

    Check out David's book and website here: http://consc.net/

    Follow Lucas on Twitter here: https://twitter.com/lucasfmperry

    Have any feedback about the podcast? You can share your thoughts here:
    www.surveymonkey.com/r/DRBFZCT

    Timestamps:

    0:00 Intro
    2:43 How this books fits into David's philosophical journey
    9:40 David's favorite part(s) of the book
    12:04 What is the thesis of the book?
    14:00 The core areas of philosophy and how they fit into Reality+
    16:48 Techno-philosophy
    19:38 What is "virtual reality?"
    21:06 Why is virtual reality "genuine reality?"
    25:27 What is the dust theory and what's it have to do with the simulation hypothesis?
    29:59 How does the dust theory fit in with arguing for virtual reality as genuine reality?
    34:45 Exploring criteria for what it means for something to be real
    42:38 What is the common sense view of what is real?
    46:19 Is your book intended to address common sense intuitions about virtual reality?
    48:51 Nozick's experience machine and how questions of value fit in
    54:20 Technological implementations of virtual reality
    58:40 How does consciousness fit into all of this?
    1:00:18 Substrate independence and if classical computers can be conscious
    1:02:35 How do problems of identity fit into virtual reality?
    1:04:54 How would David upload himself?
    1:08:00 How does the mind body problem fit into Reali…

  47. Rohin Shah on the State of AGI Safety Research in 2021

    2 november 2021 · 1 uur 44 min

    Afspelen
    Rohin Shah, Research Scientist on DeepMind's technical AGI safety team, joins us to discuss: AI value alignment; how an AI Researcher might decide whether to work on AI Safety; and why we don't know that AI systems won't lead to existential risk. Lees meer

    Topics discussed in this episode include:

    - Inner Alignment versus Outer Alignment
    - Foundation Models
    - Structural AI Risks
    - Unipolar versus Multipolar Scenarios
    - The Most Important Thing That Impacts the Future of Life

    You can find the page for the podcast here:
    https://futureoflife.org/2021/11/01/rohin-shah-on-the-state-of-agi-safety-research-in-2021

    Watch the video version of this episode here:
    https://youtu.be/_5xkh-Rh6Ec

    Follow the Alignment Newsletter here: https://rohinshah.com/alignment-newsletter/

    Have any feedback about the podcast? You can share your thoughts here:
    https://www.surveymonkey.com/r/DRBFZCT

    Timestamps:

    0:00 Intro
    00:02:22 What is AI alignment?
    00:06:00 How has your perspective of this problem changed over the past year?
    00:06:28 Inner Alignment
    00:13:00 Ways that AI could actually lead to human extinction
    00:18:53 Inner Alignment and MACE optimizers
    00:20:15 Outer Alignment
    00:23:12 The core problem of AI alignment
    00:24:54 Learning Systems versus Planning Systems
    00:28:10 AI and Existential Risk
    00:32:05 The probability of AI existential risk
    00:51:31 Core problems in AI alignment
    00:54:46 How has AI alignment, as a field of research changed in the last year?
    00:54:02 Large scale language models
    00:54:50 Foundation Models
    00:59:58 Why don't we know that AI systems won't totally kill us all?
    01:09:05 How much of the alignment and safety problems in AI will be solved by industry?
    01:14:44 Do you think about what beneficial futures look like?
    01:19:31 Moral Anti-Realism and AI
    01:27:25 Unipolar versus Multipolar Scenarios
    01:35:33 What is the safety team at DeepMind up to?
    01:35:41 What is the most important thing that impacts the future of life?

    This podcast is possible because of the sup…

  48. Future of Life Institute's $25M Grants Program for Existential Risk Reduction

    19 oktober 2021 · 25 min

    Afspelen
    Future of Life Institute President Max Tegmark and our grants team, Andrea Berman and Daniel Filan, join us to announce a $25M multi-year AI Existential Safety Grants Program. Lees meer

    Topics discussed in this episode include:

    - The reason Future of Life Institute is offering AI Existential Safety Grants
    - Max speaks about how receiving a grant changed his career early on
    - Daniel and Andrea provide details on the fellowships and future grant priorities

    Check out our grants programs here: https://grants.futureoflife.org/

    Join our AI Existential Safety Community:
    https://futureoflife.org/team/ai-exis...

    Have any feedback about the podcast? You can share your thoughts here:
    https://www.surveymonkey.com/r/DRBFZCT

    This podcast is possible because of the support of listeners like you. If you found this conversation to be meaningful or valuable, consider supporting it directly by donating at futureoflife.org/donate. Contributions like yours make these conversations possible.

  49. Filippa Lentzos on Global Catastrophic Biological Risks

    1 oktober 2021 · 58 min

    Afspelen
    Dr. Filippa Lentzos, Senior Lecturer in Science and International Security at King's College London, joins us to discuss the most pressing issues in biosecurity, big data in biology and life sciences, and governance in biological risk. Lees meer

    Topics discussed in this episode include:

    - The most pressing issue in biosecurity
    - Stories from when biosafety labs failed to contain dangerous pathogens
    - The lethality of pathogens being worked on at biolaboratories
    - Lessons from COVID-19

    You can find the page for the podcast here:
    https://futureoflife.org/2021/10/01/filippa-lentzos-on-emerging-threats-in-biosecurity/

    Watch the video version of this episode here:
    https://www.youtube.com/watch?v=I6M34oQ4v4w

    Have any feedback about the podcast? You can share your thoughts here:
    https://www.surveymonkey.com/r/DRBFZCT

    Timestamps:

    0:00 Intro
    2:35 What are the least understood aspects of biological risk?
    8:32 Which groups are interested biotechnologies that could be used for harm?
    16:30 Why countries may pursue the development of dangerous pathogens
    18:45 Dr. Lentzos' strands of research
    25:41 Stories from when biosafety labs failed to contain dangerous pathogens
    28:34 The most pressing issue in biosecurity
    31:06 What is gain of function research? What are the risks?
    34:57 Examples of gain of function research
    36:14 What are the benefits of gain of function research?
    37:54 The lethality of pathogens being worked on at biolaboratorie
    40:25 Benefits and risks of big data in biology and the life sciences
    45:03 Creating a bioweather map or using big data for biodefense
    48:35 Lessons from COVID-19
    53:46 How does governance fit in to biological risk?
    55:59 Key takeaways from Dr. Lentzos

    This podcast is possible because of the support of listeners like you. If you found this conversation to be meaningful or valuable, consider supporting it directly by donating at futureoflife.org/donate. Contributions like yours make these conversations possible.

  50. Susan Solomon and Stephen Andersen on Saving the Ozone Layer

    16 september 2021 · 1 uur 45 min

    Afspelen
    Susan Solomon, internationally recognized atmospheric chemist, and Stephen Andersen, leader of the Montreal Protocol, join us to tell the story of the ozone hole and their roles in helping to bring us back from the brink of disaster. Lees meer

    Topics discussed in this episode include:

    -The industrial and commercial uses of chlorofluorocarbons (CFCs)
    -How we discovered the atmospheric effects of CFCs
    -The Montreal Protocol and its significance
    -Dr. Solomon's, Dr. Farman's, and Dr. Andersen's crucial roles in helping to solve the ozone hole crisis
    -Lessons we can take away for climate change and other global catastrophic risks

    You can find the page for this podcast here: https://futureoflife.org/2021/09/16/susan-solomon-and-stephen-andersen-on-saving-the-ozone-layer/

    Check out the video version of the episode here: https://www.youtube.com/watch?v=7hwh-uDo-6A&ab_channel=FutureofLifeInstitute

    Check out the story of the ozone hole crisis here: https://undsci.berkeley.edu/article/0_0_0/ozone_depletion_01

    Have any feedback about the podcast? You can share your thoughts here: www.surveymonkey.com/r/DRBFZCT

    Timestamps:

    0:00 Intro
    3:13 What are CFCs and what was their role in society?
    7:09 James Lovelock discovering an abundance of CFCs in the lower atmosphere
    12:43 F. Sherwood Rowland's and Mario Molina's research on the atmospheric science of CFCs
    19:52 How a single chlorine atom from a CFC molecule can destroy a large amount of ozone
    23:12 Moving from models of ozone depletion to empirical evidence of the ozone depleting mechanism
    24:41 Joseph Farman and discovering the ozone hole
    30:36 Susan Solomon's discovery of the surfaces of high altitude Arctic clouds being crucial for ozone depletion
    47:22 The Montreal Protocol
    1:00:00 Who were the key stake holders in the Montreal Protocol?
    1:03:46 Stephen Andersen's efforts to phase out CFCs as the co-chair of the Montreal Protocol Technology and Economic Assessment Panel
    1:13:28 The Montreal Protocol helping to prevent 11 billion…