Attention Is All You Need: The Google Paper That Built ChatGPT
22 min
Listen through the publisher, then discuss the episode here or arrange an in-person Roundtable. Your city determines where to meet.
Roundtables are designed for groups of four, with a shared subject and room for everyone to speak. Come for discussion, with no dating expectation.
In 2017, eight researchers, most of them at Google, published a paper with a catchy title and a radical idea: throw out the old way of processing language and rely on "attention" instead. We explain in plain language how attention lets an AI weigh every word against every other word, why the design made giant models like GPT possible, and how the "T" in ChatGPT traces back to a paper about translation. Plus the irony of history: Google invented the transformer, but OpenAI turned it into a household name. This episode includes AI-generated content.
Episode information is provided by the publisher. Listening takes place on the publisher’s service.
I used the ChatGPT to destroy the ChatGPT - Ep. 2 - Finetuning Data and RL Models Episode release date: 30 Dec 2022 Core Ideas: Metamodernism: Narratives and emergence view of reality - Reduce suffering - Increase prosperity - Increase understanding mantra: Seek knowledge. DISCLAIMER: This is a community-driven show. ------------- Keywords: prompt engineering, ai development, ai consciousness, agi, openai, tech singularity
Project Synapse: Markets in Freefall, Fragile Infrastructure, and AI's Perfect Storm The hosts banter through the show's intro before focusing on a sense that "things are out of control," citing a WallStreetBets suicide-hotline post amid a market crash and discussing cascading system failures involving Microsoft, the FAA, and a reported NSA internal communications outage. They argue politicians and leadership lack technical competence and clear messaging, increasing panic, while emphasizing that many problems stem from aging, underfunded infrastructure and complex, brittle software (PHP, NGINX, Java), not proven AI attacks—more a "perfect storm" of crises. They debate whether AI should help fix complexity, stressing critical thinking, accountability, and using multiple AIs to verify each other. In a lightning round they cover Anthropic's IPO performance, mixed reactions and token limits with ChatGPT 6.2 (favoring "Sol" over "Astra"), Google's cheaper Neon model and confusing UX, Loblaw
In this video, Disability Attorney Walter Hnot of the Disability Resolution Law Firm goes over the positives and negatives of privatized social security benefits, with AI program projected monthly check amounts. America’s Most Viewed Social Security Disability Attorney Like the content? Review us here: https://g.page/r/CcwyektC7nCPEAg/review . If the link does not work, Google: Disability Resolution, P.A. Welcome to the largest Social Security Disability Tutorial Video Library On Earth. PRIVATE ONE HOUR SESSION PHONE CALL NEED MEDICARE? I don’t do it, but I trust these folks to help you. Call Chapter Medicare at 339 226 6287, or use askchapter.org/disability (* Note Below) THIS IS HOW YOU CAN GIVE BACK TO HELP GROW THE CAUSE: Option 1: Leave 5 |==================5 STAR REVIEWS==================| Google (Search Disability Resolution Orlando, FL)- https://g.page/r/CcwyektC7nCPEAg/review AVVO (Search Walter Hnot) - https://www.avvo.com/attorneys/32817-fl-walter-hnot-4523042/reviews.html B
#JimRohnMotivation #JimRohn #JimRohnSpeech In this Jim Rohn Motivation video, uncover 10 rules that will completely shift how you lead your life. This isn’t about motivation—it’s about structure, identity, and relentless standards that anchor your behavior and elevate your performance every day. Key Topics From This Motivational Video: Why success requires structure, not just inspiration How to enforce personal standards that never drop The danger of chasing comfort, distractions, and approval Training your mindset for clarity, consistency, and execution Living by rules that lead to identity-level transformation This Jim Rohn-style motivational video outlines a blueprint for building a high-performance life. Learn how to replace motivation with rules, emotion with execution, and hesitation with leadership. These 10 rules aren’t suggestions—they’re anchors that create stability, protect your clarity, and rewire your habits so you don’t need hype to move, just identity. This Jim Rohn Mot
You're not a victim in your life, you're a co-creator with it. In this video, Sage Robbins shares the practice of Taking Full Responsibility. It's not about self-blame, it's about recognizing that our choices, our words, our actions, and even where we place our attention shape everything we feel and experience. Uploaded 12-07-26 Sage walks through a simple question she asks herself the moment she feels resistance or tension in a relationship: "Am I cultivating harmony right now, or am I adding to the discord?" And she shares what it actually sounds like to repair a moment in real time — "I'm sorry. Can we begin again?" If you've ever caught yourself waiting for someone else to change before you can feel okay, this one's for you. Watch more videos like this I Was Humiliated… And It Made Me Who I Am: https://youtu.be/-YDXWSJ-gu0 How to Find Compassion When Someone Wrongs You: https://youtu.be/uRi3xrVjjVA The #1 Secret to Helping ANY Child Self Regulate Their Emotions: https://youtu.be/Pw
Vals AI founder Rayan Krishnan joins Theo to discuss his new report revealing that frontier AI models have few guardrails against autonomous weapons, including targeting civilians and a school in simulated and real warzone footage. They also break down GPT-6.2 Astra’s post-training limitations compared to Anthropic’s Fable models, why Anthropic is nerfing public RSI capabilities, and why Vals AI’s timeline still points to full recursive self-improvement by July 2027. MTS chronicles the singularity, live. Monitoring the situation of tech and AI. Follow MTS: Spotify |https://open.spotify.com/show/4HUNNmV1pjV7CW6Lphm1rM Apple |https://podcasts.apple.com/us/podcast/mts/id1891088763 – Brought to you by: Mongo DB - Anyone can prototype an agent. Lovable - Turn ideas into software people love with Lovable. Start today at https://lovable.dev/ Factory - A 24/7 system turning signals into production software. Visithttps://factory.com/ Neon (by Databricks) - Scale your startup on Neon. The Postgr
ChatGPT launched as a quiet "research preview" whose own staff badly underestimated how popular it would be, and it became one of the fastest-growing apps in history. We tell the seven-year story behind it, from a nonprofit with a big mission through GPT-1, GPT-2, GPT-3, and the training trick that taught a model to follow instructions. Then we explore why the chat interface mattered as much as the technology, and how one launch set off a "code red" at Google and an industry-wide race. This episode includes AI-generated content.
OpenAI unveils LifeVal, a benchmark for whether ChatGPT can handle real-life tasks like school enrollment and home searches, and pledges its data centers will cut power use when the grid is strained. Anthropic's updated IPO filing reports about $17 billion in quarterly revenue and warns it may soon cross its own line for AI-accelerated AI research. Plus: The New York Times and three other papers sue Brave over scraped journalism sold to AI companies, and Marvell's $115 billion deal for Lumentum bets on light-speed connections inside AI data centers. This episode includes AI-generated content.
OpenAI is merging ChatGPT's Chat and Work modes and putting ChatGPT and Codex on one metered token allowance, while planning a post-midterm push in Washington and signing government deals in Abu Dhabi. We also look at Nvidia's reported plan to guarantee debt on Anthropic's West Virginia data center, the banks and retailers shutting out personal AI agents like Meta's Muse, and China's AI moves as Apple brings Qwen into Siri and DeepSeek open-sources an always-on agent design. This episode includes AI-generated content.
An artist's serious misconduct should affect decisions about publicly honoring their work.
Share your view, then see how readers voted. No sign-in required. This poll is shared across stories.
Do you agree or disagree?
Common Quandary
A Common Quandary to discuss
Another conversation to explore, separate from this news story.
A stranger is behaving horribly in public. Do you record them?
You witness a stranger berating a service worker in public. Recording could create accountability and protect the worker, but posting the video could expose everyone involved to a permanent online audience.
Who gets to decide when public behavior becomes public content?