We're sunsetting PodQuest on 2025-07-28. Thank you for your support!
Export Podcast Subscriptions
cover of episode #420 — Countdown to Superintelligence

#420 — Countdown to Superintelligence

2025/6/12
logo of podcast Making Sense with Sam Harris

Making Sense with Sam Harris
AI Deep Dive AI Chapters Transcript
People
D
Daniel Kokotaljo
S
Sam Harris
Topics
Daniel Kokotaljo: 我认为AI的发展趋势非常危险，社会和公司需要为此做好准备，以避免不良后果。然而，OpenAI并没有认真对待这些担忧，也没有采取足够的措施来应对潜在的风险。我在OpenAI工作期间逐渐意识到，我们正朝着类似AI 2027中描述的未来发展，而我在内部试图改变这一趋势的努力是徒劳的。因此，我决定离开OpenAI，以便能够自由地表达我的担忧，并为AI安全贡献力量。 Sam Harris: 您离开OpenAI的决定，以及您拒绝签署禁止批评公司的协议，显示了您对AI风险的高度警惕和对原则的坚持。您能否详细描述一下当时的情况，以及您对OpenAI政策的看法？

Deep Dive

Chapters
This chapter introduces Daniel Kokotaljo and his departure from OpenAI. It highlights his concerns about the direction of AI development and his refusal to sign a non-disparagement agreement to maintain his ability to criticize the company.
  • Daniel Kokotaljo's background in AI forecasting and alignment research.
  • His departure from OpenAI due to concerns about the company's direction.
  • His refusal to sign a non-disparagement agreement and the subsequent outcome.

Shownotes Transcript

Sam Harris speaks with Daniel Kokotaljo about the potential impacts of superintelligent AI over the next decade. They discuss Daniel’s predictions in his essay “AI 2027,” the alignment problem, what an intelligence explosion might look like, the capacity of LLMs to intentionally deceive, the economic implications of recent advances in AI, AI safety testing, the potential for governments to regulate AI development, AI coding capabilities, how we’ll recognize the arrival of superintelligent AI, and other topics. If the Making Sense podcast logo in your player is BLACK, you can SUBSCRIBE to gain access to all full-length episodes at samharris.org/subscribe). Learning how to train your mind is the single greatest investment you can make in life. That’s why Sam Harris created the Waking Up) app. From rational mindfulness practice to lessons on some of life’s most important topics, join Sam as he demystifies the practice of meditation and explores the theory behind it.