AI Cannot Reliably Run a Company for Six Months | Richard Ngo
32 min
Listen through the publisher, then discuss the episode here or arrange an in-person Roundtable. Your city determines where to meet.
Roundtables are designed for groups of four, with a shared subject and room for everyone to speak. Come for discussion, with no dating expectation.
Former OpenAI governance and DeepMind safety researcher Richard Ngo analyzes why rapid recursive self-improvement timelines are overhyped and breaks down how frontier labs justify race dynamics. He explains why AI capabilities will remain jagged for years and argues that the alignment field is bottlenecked by conceptual confusion and political groupthink. -- Follow MTS: Spotify |https://open.spotify.com/show/4HUNNmV1pjV7CW6Lphm1rM Apple |https://podcasts.apple.com/us/podcast/mts/id1891088763 Interested in sponsoring the show? [email protected] – Brought to you by: Mongo DB - Anyone can prototype an agent. Lovable - Turn ideas into software people love with Lovable. Start today at https://lovable.dev/ Larridin - Finally prove what your AI investment is worth. Neon (by Databricks) - Get up to $100K in credits for your startup at https://neon.com/mts (https://neon.com/mts%E2%81%A0) Kong - The AI connectivity platform. Head over to http://getvcx.com (http://getvcx.com/) to learn more Ship 5x faster. https://blitzy.com (https://blitzy.com/) AdQuick - Make your brand a billboard. – Timestamps: (00:00) Introduction (01:01) Resigning From Frontier AI Labs (04:36) Failures of AI Alignment Movement (12:40) Robustness Bottlenecks and Jagged Capabilities (17:26) Alignment as a Capabilities Bottleneck (22:17) Strategy for AI Safety Movement (27:19) Politics and Rationalist Groupthink –
Episode information is provided by the publisher. Listening takes place on the publisher’s service.
My guest today is Hayden Field, The Verge’s senior AI reporter, and we’re discussing the Anthropic IPO for our third and final episode in our series about AI in real life. The numbers are gigantic, but not really that important. The real story is what happens now — and whether Anthropic can continue to thread the needle of caring about and investing in AI safety while also being a public company beholden to shareholders. So you’ll hear Hayden and I dive into this tension, and what to make of Anthropic’s unique corporate governance structure in the wake of the Jensen Huang saga. Read the full interview transcript on The Verge. (https://www.theverge.com/e/1038701) Links: With biggest IPO of all time, Anthropic’s ‘good guy’ reputation is on the line | The Verge (https://www.theverge.com/ai-artificial-intelligence/1037459/anthropic-ipo-safe-ai-reputation-power-structure) Anthropic starts trading on Wall Street | The Verge (https://www.theverge.com/ai-artificial-intelligence/1035384/anthrop
What if your AI agent could find the people you should know before you even start looking? Cosign is building a professional network around reputation and trusted recommendations, and now agents can use that network too. MTS host Sophia Dew sits down with a16z’s David Booth and Cosign’s Bella Nazzari to discuss what they’ve learned since launching Cosign, why traditional profiles often miss the operators doing the most important work, and how the Cosign Awards are surfacing talent through the people willing to vouch for them. They also explore an emerging behavior: people connecting their agents to Cosign to continuously find relevant people, lists, and opportunities, and what professional networking could look like when both humans and their agents participate. Resources: Follow David Booth: https://x.com/davidbooth Follow Bella Nazzari: https://x.com/nazzari Follow Sophia Dew: https://x.com/sophiadew Learn more about Cosign:https://cosign.co/ Connect your agent to Cosign:https://cosi
Zvi does the reading on OpenAI’s system card for GPT-6.2 Astra and Sol: the first externally deployed model to meet OpenAI’s High threshold for AI self-improvement, already at Critical for cybersecurity. He works through the preparedness results, the safeguards against misuse, distillation and model escape, and the alignment and monitorability findings, including rising evaluation awareness, reasoning that happens without visible chain of thought, and UK AISI’s tour of misaligned behaviours, asking what the numbers do and don’t show. This has been an Askwho Casts audio conversion. Thanks for listening. * 00:00 - Introduction * 01:10 - Table of Contents * 02:45 - Safety Overview (1) * 05:19 - Internal Deployment (1.2) * 05:32 - Preparedness Assessment (2) * 06:40 - Biological Threats (2.1.1) * 09:55 - Cyber Threats (2.1.2) * 11:36 - AI Self-Improvement Threats (2.1.3) * 14:32 - OpenAI Epoch Capabilities Index (OECI) * 16:10 - Safeguards (2.2) * 17:34 - AI Self-Improvement Threat Modelin
What NVIDIA is trying to build next… You're probably hearing a lot about AI, DeepSeek, NVIDIA and more right now. If you want the big picture (and to start from the beginning), watch this Huge Conversation with NVIDIA CEO Jensen Huang. In the last few years, NVIDIA has skyrocketed to become one of the world's most valuable companies. That's because, beginning in the 90s, they led a fundamental shift in how computers work, now unleashing the current explosion of what’s possible with technology. A huge amount of the most futuristic tech you’re hearing about - in AI, robotics, gaming, self-driving cars, breakthrough medical research - relies on new chips and software designed by him and his company. During the dozens of background interviews I did to prepare for this, what struck me most was how much Jensen Huang has already influenced all our lives over the last 30 years, and how many are saying it’s just the beginning of something even bigger… We all need to know what he’s building and
Palo Alto Networks has agreed to acquire the artificial intelligence startup Applied Compute in an all-stock transaction valued at $4.5 billion. Founded by former OpenAI researchers, Applied Compute specializes in helping businesses train and deploy customized open-weight AI models using their own proprietary data. This strategic purchase enables the cybersecurity giant to expand beyond traditional security offerings and embed protection directly into corporate AI infrastructure. Alongside the acquisition announcement, Palo Alto reported strong quarterly financial results that pushed its shares up significantly and led the company to raise its annual revenue forecast. Ultimately, the deal highlights a broader industry trend where major tech firms are rapidly absorbing specialized artificial intelligence capabilities to meet growing enterprise demand.
Answering questions you asked me on instagram, casual Sunday Q&A My private network for entrepreneurs ⚜ - http://newelite.pro (http://newelite.pro/) The 90 day savage challenge (my training, nutrition & testosterone protocol) - https://the90daysavage.com/ The exact blueprint I used to create my brand. (apply here to work with me) -http://iconblueprint.com/m072 FREE weekly self improvement audio tapes - https://open.spotify.com/show/33lFOq1XUKLdOeIM549qQ6?si=OTmEw-iHRiusyWYM-hp71g My Instagram - https://www.instagram.com/itsjackhopkins?igsh=aGhqMm1iNHg2eXg5&utm_source=qr (https://www.instagram.com/itsjackhopkins?igsh=aGhqMm1iNHg2eXg5)
Vals AI founder Rayan Krishnan joins Theo to discuss his new report revealing that frontier AI models have few guardrails against autonomous weapons, including targeting civilians and a school in simulated and real warzone footage. They also break down GPT-6.2 Astra’s post-training limitations compared to Anthropic’s Fable models, why Anthropic is nerfing public RSI capabilities, and why Vals AI’s timeline still points to full recursive self-improvement by July 2027. MTS chronicles the singularity, live. Monitoring the situation of tech and AI. Follow MTS: Spotify |https://open.spotify.com/show/4HUNNmV1pjV7CW6Lphm1rM Apple |https://podcasts.apple.com/us/podcast/mts/id1891088763 – Brought to you by: Mongo DB - Anyone can prototype an agent. Lovable - Turn ideas into software people love with Lovable. Start today at https://lovable.dev/ Factory - A 24/7 system turning signals into production software. Visithttps://factory.com/ Neon (by Databricks) - Scale your startup on Neon. The Postgr
Peter Wildeford, Head of Policy at the AI Policy Network and a top forecaster, joins MTS to discuss accelerating AI R&D automation, timelines for replacing human AI researchers, and the growing bipartisan push in Congress and California to ban runaway recursive self-improvement. He also breaks down recent critical infrastructure outages caused by rushed patching of AI-discovered cyber vulnerabilities. MTS chronicles the singularity, live. Monitoring the situation of tech and AI. Follow MTS: Spotify |https://open.spotify.com/show/4HUNNmV1pjV7CW6Lphm1rM Apple |https://podcasts.apple.com/us/podcast/mts/id1891088763 – Brought to you by: Mongo DB - Anyone can prototype an agent. Lovable - Turn ideas into software people love with Lovable. Start today at https://lovable.dev/ Factory - A 24/7 system turning signals into production software. Visithttps://factory.com/ Neon (by Databricks) - Scale your startup on Neon. The Postgres backend for apps and agents. Built by Databricks.https://neon.co
Superhuman CEO Shishir Mehrotra joins MTS to discuss the company’s new agent platform, Superhuman Go, and how embedding AI directly into existing workspaces solves the “last mile” problem of enterprise adoption. He also breaks down Grammarly’s custom model infrastructure, the challenge of measuring human-agent productivity, and his prediction for a massive surge in AI inference over the next year. -- MTS chronicles the singularity, live. Monitoring the situation of tech and AI. Follow MTS: Spotify |https://open.spotify.com/show/4HUNNmV1pjV7CW6Lphm1rM Apple |https://podcasts.apple.com/us/podcast/mts/id1891088763 – Brought to you by: Mongo DB - Anyone can prototype an agent. Lovable - Turn ideas into software people love with Lovable. Start today at https://lovable.dev/ Factory - A 24/7 system turning signals into production software. Visithttps://factory.com/ Neon (by Databricks) - Scale your startup on Neon. The Postgres backend for apps and agents. Built by Databricks.https://neon.com
New local ventures should actively contribute to the surrounding community.
Share your view, then see how readers voted. No sign-in required. This poll is shared across stories.
Do you agree or disagree?
Common Quandary
A Common Quandary to discuss
Another conversation to explore, separate from this news story.
Your family connection could get your child into their dream school. Do you use it?
A university argues that considering family ties builds loyalty and encourages donations that fund scholarships. Critics say the preference preserves inherited advantage and takes places from stronger applicants.
Can benefits to the whole institution justify an unequal admissions advantage?