English-language podcasts

Dwarkesh Podcast

The avalanche that hit math is coming for AI development

45 min

Listen through the publisher, then discuss the episode here or arrange an in-person Roundtable. Your city determines where to meet.

Roundtables are designed for groups of four, with a shared subject and room for everyone to speak. Come for discussion, with no dating expectation.

If you asked me earlier this year how far away we are from superintelligence, I’d probably have said at least the better part of a decade. But over the last three months, from debating people on and off the podcast, I’ve updated my views a ton. Let me walk you through how my thinking has changed. If you want to read the written version (with footnotes and links) you can check it out here: https://www.dwarkesh.com/p/rsi This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit www.dwarkesh.com (https://www.dwarkesh.com/)

Episode information is provided by the publisher. Listening takes place on the publisher’s service.

Listen at the source ↗

Featured places to meet in Palo Alto, CA

Explore these places and arrange a conversation through ThinkMatch.

City guide for Palo Alto, CA

More from Dwarkesh Podcast

Dwarkesh Podcast

Paul Christiano – We could be 12 months away from AIs that can overthrow the government

99 min

Paul Christiano (https://paulfchristiano.com/) is head of the Alignment Research Center. Previously, he was head of AI safety at the US AI Safety Institute. Before that, he led alignment at OpenAI, where he invented RLHF. He’s recently joined OpenAI’s board (though here he is speaking as a private citizen). Paul thinks that on the current trajectory (absent any slowing down), there is a 1 in 3 chance that we could have superintelligence powerful enough to overthrow the government within a year. (He articulates a concrete scenario). He argues that the labs should pause further algorithmic progress until they can secure their weights and research secrets. Otherwise China could simply steal the superintelligence in the middle of the intelligence explosion, and the labs would no longer be able to slow down even if they saw their models going off the rails. He also explains how AIs will be trained during the intelligence explosion, and why even a system trained entirely inside a data center

Discuss this episode

Community Poll

Clubs should reject lucrative sponsors whose activities conflict with their stated values.

Share your view, then see how readers voted. No sign-in required. This poll is shared across stories.

Do you agree or disagree?

Choose one answer

Common Quandary

A Common Quandary to discuss

Another conversation to explore, separate from this news story.

The company allows an $80 dinner. Is ordering the lobster fair game?

During work travel, company policy permits an expensive dinner. A modest option is nearby, but colleagues choose the nicest restaurant because the company can easily afford it and everyone is within the stated limit.

Is following a rule enough when you are spending someone else's money?

Explore this quandary