The Attention Mechanism with Andrew Mayne

Andrew and Justin discuss what's turned out to be a busy July for frontier models, including the launch of Kimi K3, the latest in Anthropic's Fable saga, and the arrival of GPT-5.6. They also dive into Anthropic's strange World Cup ad campaign and OpenAI's relaunched desktop app.You can watch a video version of this podcast here: https://youtu.be/bTUfneEBn14Chapters00:00:00 - Intro00:01:11 - Kimi and Chinese Models00:08:26 - Google's Position00:21:47 - Anthropic's Fable Saga00:32:31 - Anthropic's World Cup Ad Campaign00:40:09 - GPT-5.600:50:10 - Sites, Speech, and Desktop00:57:42 - Wrap-up

Andrew and Justin discuss the return of Fable, which arrives with some slight performance changes after a prolonged fight between Anthropic and the US government. What's the future of Anthropic's flagship model, and does it point to the arrival of GPT-5.6 in the coming days? They also discuss GLM-2, Chinese models, and the age of token efficiency, plus a quick look at that Alex Karp interview blowing up your timeline.The Attention Mechanism is now available in video! Check it out here.Chapters00:00 - Intro01:35 - Fable's Return21:33 - GPT-5.630:57 - Chinese Models46:59 - Alex Karp's CNBC Interview53:00 - Wrap-up

Andrew and Justin take a look at the continuing fallout of Anthropic's fight with the government, including the delayed general availability of OpenAI's GPT-5.6. Plus, is China catching up with the US in terms of model performance, agentic apps continue to make their way to mobile devices, and is Apple's recent RAM-related price hike a permanent blemish on the end of Tim Cook's career?Chapters00:00:00 - Intro00:01:02 - Anthropic Fallout Continues00:14:45 - China's Window?00:30:22 - Anthropic and OpenAI Timeline Predictions00:31:53 - GPT-5.600:38:22 - 5.6 on Cerberus00:44:58 - Mobile Agents00:52:23 - Apple's Price Hikes01:00:31 - Wrap-up

Andrew and Justin dive into the ongoing drama surrounding Anthropic and the US government, as an emergency export control directive forced the AI giant to suspend access to both Mythos 5 and Fable 5. Chapters00:00:00 - Intro00:02:08 - Anthropic00:27:48 - Fable 5, ChatGPT 5.6, and Model Performance00:44:58 - Meta and the AI Window01:01:25 - Wrap-up

Andrew and Justin dig into Apple's latest — and Tim Cook's final — WWDC, where Apple Intelligence once again promised to change how you use your iPhone. They also dive into the ongoing IPO races with several S-1 filings, dig into superapp rumors, and pour one out for Pulse.Chapters00:00 - Intro01:32 - WWDC13:56 - IPO30:12 - Mythos, Codex, and superapps49:14 - RIP Pulse and wrap-up

Andrew and Justin recap Google's big announcements coming out of this year's I/O conference. Aside from its new Omni video model, what else left the pair excited about Google's AI efforts? Honestly, not a ton. They also discuss "tokenmaxxing," before digging into a new report surrounding Anthropic's eventual plans for Mythos.Chapters00:00 - Intro02:37 - Google I/O (good!)09:20 - Google I/O (bad!)27:22 - Tokenmaxxing36:29 - Mythos43:22 - Wrap-up

Andrew and Justin talk through the fallout of the Elon Musk vs. Sam Altman lawsuit, which played out in dramatic fashion over the last couple of weeks before ending prematurely on a statue of limitations ruling.Chapters00:00 - Intro00:36 - Musk v. Altman32:35 - Google I/O36:16 - Wrap-up

Andrew and Justin reconvene to talk about a busy couple of weeks in AI, including diving into Andrew's time at OpenAI's 5.5 launch party. Before that, the two discuss the new compute partnership between xAI and Anthropic and wonder what it might mean for the future of Elon's company ahead of its IPO, and eventually dig into the arrival of Realtime 2, why you can't buy a Mac Mini, and much more.Chapters00:00:00 - Intro00:01:36 - xAI and Anthropic00:18:51 - The 5.5 Launch Party00:23:17 - Good Vibes and Rumors at OpenAI00:40:09 - Realtime 200:49:47 - Thinking Machines01:01:20 - Wrap-up