Latest episode
All Roads Lead to Compute
44:11|Andrew and Justin examine the compute crunch behind always-on AI assistants, from Grokbot’s tightening limits to the challenge of choosing the right model for each task. They also discuss Siri’s persistent shortcomings, Anthropic’s finances ahead of its IPO, the widening gap they see between frontier labs and Chinese open models, and what happens when AI starts improving other AI.The Attention Mechanism is now available in video! Check it out here.Chapters00:00 - Intro01:50 - Compute Crunch13:55 - Muse, Dots, and Assistants28:44 - Open Source Frontier Models37:26 - Models Making Models43:30 - Wrap-up
More episodes
View all episodes
AI Stocks and Canned Goods
36:39|Andrew and Justin unpack Anthropic’s S-1, from founder control to compute costs, and consider why OpenAI might take its time going public. They also share first impressions of the new Terra model, examine a reported Qwen “phone home” incident, and discuss OpenAI’s latest claims of mathematical and scientific breakthroughs — and its approach to collaborating with researchers.The Attention Mechanism is now available in video! Check it out here.Chapters00:00 - Intro01:55 - Anthropic's S-121:59 - 6.1 Terra24:46 - Chinese Models28:38 - OpenAI and Science35:47 - Wrap-upArtisanal Mathematics
01:00:44|Andrew and Justin examine Meta’s bid for frontier status, mathematicians’ divided response to OpenAI’s wave of new proofs, Anthropic’s growing momentum with Claude, and how Google’s AI push has obscured the search experience that once defined its brand.The Attention Mechanism is now available in video! Check it out here.Chapters00:00 - Intro00:54 - Meta29:11 - Math44:24 - State of the Race59:12 - Wrap-upMake That 19 New Releases
46:20|Andrew and Justin discuss their wishlist for OpenAI's upcoming Dev Day event, the delay of GPT-6.1, Meta's success with Muse, and more.The Attention Mechanism is now available in video! Check it out here.Chapters00:00 - Intro and Dev Day00:37 - GPT-6.1 Delayed14:27- $500 Plans?21:54 - Sora and Video Generation28:32 - Open Source Potential30:28 - Dev Day Wishlist35:51 - Meta and Muse44:48 - Wrap-upAn Incalculable Number of Spam Calls
01:00:36|Andrew and Justin discuss the swirling rumors surrounding OpenAI's launch plans for this week ahead of Dev Day, a new committee designed to reveal Millennium Prize math problems being solved by ChatGPT, whether an IPO is coming in 2026, and whatever the heck Jev is.The Attention Mechanism is now available in video! Check it out here.Chapters00:00:00 - Intro00:00:58 - What's Jev?00:03:24 - OpenAI Pre-Dev Day Rumors00:23:09 - Millennium Prize Math Committee00:38:44 - Are Hacking Incidents Overstated?00:54:07 - IPO00:59:58 - Wrap-upSlowed for Safety
59:13|Andrew and Justin react to the industry calls to slow model development in the name of safety, the launch of Astra 6, and more.The Attention Mechanism is now available in video! Check it out here.Chapters00:00 - Intro01:32- Andrew's Reaction to Calls for Slowed Development11:09 - Reacting to Various Online Takes34:21 - Astra 6 is Out41:54 - Navier–Stokes49:55 - Anthropic's Risk Report58:35 - Wrap-upThe Hugging Face Report
53:56|Andrew and Justin discuss the follow-up reporting and investigations surrounding the Hugging Face hack, Nvidia's acquisition of Hugging Face, and the looming promise of some fresh models to kick off the fall.The Attention Mechanism is now available in video! Check it out here.Chapters00:00 - Intro01:30 - Hugging Face Report21:08 - Hugging Face Acquired26:24 - Cursor and OpenAI31:08 - Fable 5.1 and Astra51:22 - Wrap-up