The Attention Mechanism with Andrew Mayne

Andrew and Justin discuss the Hugging Face breach, which saw an unreleased OpenAI model find its way into the company's systems during internal testing. They also discuss the launch of Opus 5, the ongoing progress made by Chinese models, and the crunch for compute as 10GW data center plans start to make some motion. Plus, a tribute to the late John C. Dvorak.The Attention Mechanism is now available in video! Check it out here.Chapters00:00 - Intro01:23 - Hugging Face15:45 - Chinese Models26:01 - Opus 536:11 - 10GW Data Centers52:29 - RIP John C. Dvorak

Andrew and Justin discuss what's turned out to be a busy July for frontier models, including the launch of Kimi K3, the latest in Anthropic's Fable saga, and the arrival of GPT-5.6. They also dive into Anthropic's strange World Cup ad campaign and OpenAI's relaunched desktop app.You can watch a video version of this podcast here: https://youtu.be/bTUfneEBn14Chapters00:00:00 - Intro00:01:11 - Kimi and Chinese Models00:08:26 - Google's Position00:21:47 - Anthropic's Fable Saga00:32:31 - Anthropic's World Cup Ad Campaign00:40:09 - GPT-5.600:50:10 - Sites, Speech, and Desktop00:57:42 - Wrap-up

Andrew and Justin discuss the return of Fable, which arrives with some slight performance changes after a prolonged fight between Anthropic and the US government. What's the future of Anthropic's flagship model, and does it point to the arrival of GPT-5.6 in the coming days? They also discuss GLM-2, Chinese models, and the age of token efficiency, plus a quick look at that Alex Karp interview blowing up your timeline.The Attention Mechanism is now available in video! Check it out here.Chapters00:00 - Intro01:35 - Fable's Return21:33 - GPT-5.630:57 - Chinese Models46:59 - Alex Karp's CNBC Interview53:00 - Wrap-up

Andrew and Justin take a look at the continuing fallout of Anthropic's fight with the government, including the delayed general availability of OpenAI's GPT-5.6. Plus, is China catching up with the US in terms of model performance, agentic apps continue to make their way to mobile devices, and is Apple's recent RAM-related price hike a permanent blemish on the end of Tim Cook's career?Chapters00:00:00 - Intro00:01:02 - Anthropic Fallout Continues00:14:45 - China's Window?00:30:22 - Anthropic and OpenAI Timeline Predictions00:31:53 - GPT-5.600:38:22 - 5.6 on Cerberus00:44:58 - Mobile Agents00:52:23 - Apple's Price Hikes01:00:31 - Wrap-up

Andrew and Justin zoom in on the continued fallout surrounding Anthropic following the government's decision to issue an export-control directive on its Mythos-based models. Now that it's been over a week, what are the next steps for Dario Amodei's company? They also discuss the pending launch of GPT-5.6 and the ongoing AI brain drain currently happening in the offices of Google.Chapters00:00:00 - Intro00:01:42 - Anthropic00:23:02 - GPT-5.600:42:48 - Google Brain Drain01:03:29 - Wrap-up

Andrew and Justin dive into the ongoing drama surrounding Anthropic and the US government, as an emergency export control directive forced the AI giant to suspend access to both Mythos 5 and Fable 5. Chapters00:00:00 - Intro00:02:08 - Anthropic00:27:48 - Fable 5, ChatGPT 5.6, and Model Performance00:44:58 - Meta and the AI Window01:01:25 - Wrap-up