English-language podcasts

Podcasts

Dwarkesh Podcast

An episode can be the start of a conversation. Explore recent releases, share your thoughts, and meet through a ThinkMatch Roundtable.

Ask friends about this

Episodes to discuss

Dwarkesh Podcast

Paul Christiano – We could be 12 months away from AIs that can overthrow the government

99 min

Paul Christiano (https://paulfchristiano.com/) is head of the Alignment Research Center. Previously, he was head of AI safety at the US AI Safety Institute. Before that, he led alignment at OpenAI, where he invented RLHF. He’s recently joined OpenAI’s board (though here he is speaking as a private citizen). Paul thinks that on the current trajectory (absent any slowing down), there is a 1 in 3 chance that we could have superintelligence powerful enough to overthrow the government within a year. (He articulates a concrete scenario). He argues that the labs should pause further algorithmic progress until they can secure their weights and research secrets. Otherwise China could simply steal the superintelligence in the middle of the intelligence explosion, and the labs would no longer be able to slow down even if they saw their models going off the rails. He also explains how AIs will be trained during the intelligence explosion, and why even a system trained entirely inside a data center

Discuss this episode

Dwarkesh Podcast

The avalanche that hit math is coming for AI development

45 min

If you asked me earlier this year how far away we are from superintelligence, I’d probably have said at least the better part of a decade. But over the last three months, from debating people on and off the podcast, I’ve updated my views a ton. Let me walk you through how my thinking has changed. If you want to read the written version (with footnotes and links) you can check it out here: https://www.dwarkesh.com/p/rsi This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit www.dwarkesh.com (https://www.dwarkesh.com/)

Discuss this episode