English-language podcasts

Semi Doped

Google Built Two New TPUs Without New Silicon: The 8i Max and 8TX

54 min

Listen through the publisher, then discuss the episode here or arrange an in-person Roundtable. Your city determines where to meet.

Roundtables are designed for groups of four, with a shared subject and room for everyone to speak. Come for discussion, with no dating expectation.

Austin Lyons and Vik Sekar break down Google's two new TPU systems, the 8i Max and 8TX. These are not new silicon but new system configurations of the existing V8 chip, designed for specific workloads. The conversation covers the 8i Max's use of advanced packaging to increase density and the 8TX's swap to an AMD CPU to enable confidential computing for multi-tenant cloud customers. Accounts are free, and get $5 in credit when you sign up. Try Serverless Fine-Tuning: https://semidoped.com/crusoe Key Takeaways: - Google's new TPUs are system-level innovations, not new silicon. The 8i Max and 8TX are both built around the existing V8 chip, signaling a strategy of diversifying offerings around a single generation. - The 8i Max is a packaging play. It places two 8i chips on one module to double on-chip SRAM to ~768 MB, creating a single logical processor for long-context and agentic workloads. - The 8TX system is built for security, not performance. It combines 8T training silicon with an inference network (Boardfly) and an AMD EPYC CPU to deliver confidential computing via AMD's SEV technology. - The choice of AMD's EPYC CPU over Google's own Axion is a time-to-market decision. It gives Google's cloud customers a mature, flight-tested hardware security feature without waiting for an in-house version. - The 'Max' branding signals a roadmap. Austin and Vik speculate that this year's premium dual-die 8i Max configuration will likely become the baseline for next year's TPU 9i. - Software unlocks the hardware's value. The new TPU Sync layer manages the memory hierarchy (HBM, DRAM, SSD), cutting KV cache transfer overhead by 90% and improving time-to-first-token. This episode is supported by Meter. You have the GPUs and the power. One call reaches the team that designed the hardware and wrote the software. https://semidoped.com/meterGoogle's two new TPU systems, the 8i Max and 8TX are not new silicon but new system configurations of the existing V8 chip. The 8i Max uses advanced packaging to increase density and the 8TX swaps to an AMD CPU to enable confidential computing for multi-tenant cloud customers. Accounts are free, and get $5 in credit when you sign up. Try Serverless Fine-Tuning: https://semidoped.com/crusoe Key Takeaways: - Google's new TPUs are system-level innovations, not new silicon. The 8i Max and 8TX are both built around the existing V8 chip, signaling a strategy of diversifying offerings around a single generation. - The 8i Max is a packaging play. It places two 8i chips on one module to double on-chip SRAM to ~768 MB, creating a single logical processor for long-context and agentic workloads. - The 8TX system is built for security, not performance. It combines 8T training silicon with an inference network (Boardfly) and an AMD EPYC CPU to deliver confidential computing via AMD's SEV technology. - The choice of AMD's EPYC CPU over Google's own Axion is a time-to-market decision. It gives Google's cloud customers a mature, flight-tested hardware security feature without waiting for an in-house version. - The 'Max' branding signals a roadmap. Austin and Vik speculate that this year's premium dual-die 8i Max configuration could become the baseline for next year's TPU 9i. - Software unlocks the hardware's value. The new TPU Sync layer manages the memory hierarchy (HBM, DRAM, SSD), cutting KV cache transfer overhead by 90% and improving time-to-first-token. This episode is supported by Meter. You have the GPUs and the power. Chapters: 0:00 Not New Silicon, New Systems 7:28 Refresher: 8T vs. 8i 12:42 Defining the 8i Max 13:59 The 'Mirror Chip' Mistake 18:47 Packaging vs. Optics 22:42 The 'iPhone' Naming Strategy 23:09 Defining the 8TX 28:51 How Confidential Computing Works 30:03 Why AMD? SEV Technology 39:58 Fine-Tuning on the 8TX 42:37 TPU Sync: The Software Layer 51:48 Dogfooding as an Advantage Follow Chipstrat: Newsletter: https://www.chipstrat.com X: https://x.com/chipstrat Follow Vik: Newsletter: https://www.viksnewsletter.com/ X: https://x.com/vikramskr Follow Semi Doped: Chapters: 0:00 Not New Silicon, New Systems 7:28 Refresher: 8T vs. 8i 12:42 Defining the 8i Max 13:59 The 'Mirror Chip' Mistake 18:47 Packaging vs. Optics 22:42 The 'iPhone' Naming Strategy 23:09 Defining the 8TX 28:51 How Confidential Computing Works 30:03 Why AMD? SEV Technology 39:58 Fine-Tuning on the 8TX 42:37 TPU Sync: The Software Layer 51:48 Dogfooding as an Advantage Follow Chipstrat: Newsletter: https://www.chipstrat.com X: https://x.com/chipstrat Follow Vik: Newsletter: https://www.viksnewsletter.com/ X: https://x.com/vikramskr Follow Semi Doped:

Episode information is provided by the publisher. Listening takes place on the publisher’s service.

Listen at the source ↗

Featured places to meet in Palo Alto, CA

Explore these places and arrange a conversation through ThinkMatch.

City guide for Palo Alto, CA

More from Semi Doped

Semi Doped

Jensen Huang Resigns

32 min

Jensen Huang resigned as Nvidia CEO this morning, and Austin and Vik recorded two hours after the news broke. They argue that a board must prioritize corporate integrity over short-term shareholder value, even for a legendary founder. The discussion then turns to Nvidia's critical lack of a succession plan and the long-term risk of the company's unique, founder-led culture decaying into bureaucracy. Accounts are free, and get $5 in credit when you sign up. Try Serverless Fine-Tuning: https://semidoped.com/crusoe Key Takeaways: - A board's first duty is governance, not shareholder value. Even a founder CEO must be forced out for breaking company rules, because keeping them sends a message that lying and rule-breaking are acceptable. - The hardest job demands the highest standard. The immense pressure of being Nvidia's CEO is the reason for strict conduct rules, not an excuse for leniency. - Nvidia has no succession plan — Ian Buck is the only plausible internal CEO candidate. Unlike com

Discuss this episode

Semi Doped

Intel's Earnings Disaster: Bad Luck, Bad Planning, or Both?

58 min

Intel just had its worst day on the stock market in 55 years, with shares falling nearly 30%. But here's the strange part: Intel actually reported a strong quarter. Revenue grew, its data center business surged, and the company beat expectations. So what went wrong? In this episode of Semi Doped, Vik Sekar and Austin Lyons dig into Intel's Q3 2026 earnings and the problems behind its disappointing outlook. Three issues are at the center of Intel's troubles: a weakening PC market driven by rising memory prices, a shortage of advanced packaging substrates that limits server CPU production, and a tragic factory accident in Israel that disrupted chiplet supply. But how much of this was bad luck, and how much was poor planning? We debate whether Intel should have anticipated the surge in demand for server CPUs from agentic AI, whether its manufacturing strategy can respond quickly enough, and what these problems mean for its ambitions to become a leading-edge foundry alternative to TSMC. We

Discuss this episode

Semi Doped

3D Stacked DRAM for Inference: d-Matrix's Sudeep Bhoja

76 min

The fundamental physics of data movement are forcing a shift to new memory architectures for AI inference. Sudeep Bhoja, co-founder and CTO of d-Matrix, joins Vik to detail the company's journey from a non-consensus bet on memory-bound inference to a full-rack 3D-stacked DRAM solution. Sudeep explains the pivot from analog to digital in-memory compute, the system-level disaggregation strategies for their Corsair card, and how the next-generation Raptor chip integrates with Nvidia's ecosystem. "Essentially, we got 16 times the capacity of SRAM, while we retained SRAM bandwidth." — Sudeep Bhoja, d-Matrix When we sat down with Crusoe’s product team, Austin asked: what will you do with my data? Their answer: They don’t touch or see it. Your training data is encrypted so even Crusoe’s own admins can’t see it, and the fine-tuned model is yours. Run a few versions, compare them, and download the one that works best. Accounts are free, and get $5 in credit when you sign up. Try Serverless Fine

Discuss this episode

Community Poll

Allegations should not be treated as proven until a fair process establishes the facts.

Share your view, then see how readers voted. No sign-in required. This poll is shared across stories.

Do you agree or disagree?

Choose one answer

Common Quandary

A Common Quandary to discuss

Another conversation to explore, separate from this news story.

A likable but unreliable former employee lists you as a reference. How honest are you?

A former employee who was unreliable but personally likable lists you as a reference without asking. Their prospective manager calls and asks only whether you would hire them again.

How much truth do you owe a stranger when it may cost someone a fresh start?

Explore this quandary