The Attention Mechanism with Andrew Mayne

Andrew and Justin discuss the return of Fable, which arrives with some slight performance changes after a prolonged fight between Anthropic and the US government. What's the future of Anthropic's flagship model, and does it point to the arrival of GPT-5.6 in the coming days? They also discuss GLM-2, Chinese models, and the age of token efficiency, plus a quick look at that Alex Karp interview blow...

Andrew and Justin take a look at the continuing fallout of Anthropic's fight with the government, including the delayed general availability of OpenAI's GPT-5.6. Plus, is China catching up with the US in terms of model performance, agentic apps continue to make their way to mobile devices, and is Apple's recent RAM-related price hike a permanent blemish on the end of Tim Cook's career? Chapters 00...

Andrew and Justin zoom in on the continued fallout surrounding Anthropic following the government's decision to issue an export-control directive on its Mythos-based models. Now that it's been over a week, what are the next steps for Dario Amodei's company? They also discuss the pending launch of GPT-5.6 and the ongoing AI brain drain currently happening in the offices of Google. Chapters 00:00:00...

Andrew and Justin dive into the ongoing drama surrounding Anthropic and the US government, as an emergency export control directive forced the AI giant to suspend access to both Mythos 5 and Fable 5. Chapters 00:00:00 - Intro 00:02:08 - Anthropic 00:27:48 - Fable 5, ChatGPT 5.6, and Model Performance 00:44:58 - Meta and the AI Window 01:01:25 - Wrap-up Hosted on Acast. See acast.com/privacy for mo...

Andrew and Justin dig into Apple's latest — and Tim Cook's final — WWDC, where Apple Intelligence once again promised to change how you use your iPhone. They also dive into the ongoing IPO races with several S-1 filings, dig into superapp rumors, and pour one out for Pulse. Chapters 00:00 - Intro 01:32 - WWDC 13:56 - IPO 30:12 - Mythos, Codex, and superapps 49:14 - RIP Pulse and wrap-up Hosted on...

Andrew and Justin recap Google's big announcements coming out of this year's I/O conference. Aside from its new Omni video model, what else left the pair excited about Google's AI efforts? Honestly, not a ton. They also discuss "tokenmaxxing," before digging into a new report surrounding Anthropic's eventual plans for Mythos. Chapters 00:00 - Intro 02:37 - Google I/O (good!) 09:20 - Google I/O (ba...

Andrew and Justin talk through the fallout of the Elon Musk vs. Sam Altman lawsuit, which played out in dramatic fashion over the last couple of weeks before ending prematurely on a statue of limitations ruling. Chapters 00:00 - Intro 00:36 - Musk v. Altman 32:35 - Google I/O 36:16 - Wrap-up Hosted on Acast. See acast.com/privacy for more information.

Andrew and Justin reconvene to talk about a busy couple of weeks in AI, including diving into Andrew's time at OpenAI's 5.5 launch party. Before that, the two discuss the new compute partnership between xAI and Anthropic and wonder what it might mean for the future of Elon's company ahead of its IPO, and eventually dig into the arrival of Realtime 2, why you can't buy a Mac Mini, and much more. Ch...

Andrew and Justin discuss Anthropic's increasingly high compute demands, leading to frequent downtime and throttled usage, and compare it to OpenAI's treatment of its Codex users and the recent decision to shutter Sora. They also discuss Anthropic's Mythos announcement and its warnings surrounding cybersecurity, along with some thoughts on the IPO race for both companies. Chapters 00:00 - Intro 01...

Andrew and Justin dive into the rumors surrounding Anthropic's Mythos and OpenAI's Spud. With IPOs on the horizon for both companies, are we looking at an all-new kind of tech rivalry? Chapters 00:00 - Intro 00:22 - Mythos and Spud Expectations 13:28 - Anthropic-OpenAI Rivalry 20:50 - Claude's Hiccups 27:38 - Sora's Death 45:12 - Wrap-up Hosted on Acast. See acast.com/privacy for more information.

Andrew and Justin dive into the recent drama surrounding Cursor. The team behind the beloved AI coding tool recently launched their own model to compete against the likes of Anthropic and OpenAI without specifically disclosing that their product was actually built on top of Chinese LLMs. After, they discuss reports that OpenAI might bundle its various projects into one single application, asking w...

Andrew and Justin discuss how AI is shaping health, ranging from a dog that appears to have been saved from cancer thanks to AI-enabled research to the ongoing push into this field by OpenAI. They also discuss Nvidia's recent earnings report, showing off advanced guidance that seems to point to ever-increasing compute demand. Chapters 00:00 - Intro 01:10 - Dog's Cancer Diagnosis 09:49 - Broader He...

Andrew and Justin reconvene to discuss Anthropic's recent claims that Chinese AI labs are utilizing Claude to improve their own models, before turning their attention to Anthropic's ongoing rocky relationship with the Pentagon. Elsewhere, the two ponder what's happening with local town board meetings grabbing headlines for turning away data centers — and whether a NIMBY response to data centers co...

Andrew and Justin discuss the recent acqui-hire Peter Steinberger, the founder behind OpenClaw (né Clawdbot, né Moltbot), with his project remaining open-source. The two also discuss the reaction to the depreciation of GPT-4o, which left plenty of users feeling burned, and the recent high-profile departures of various employees who got their exit letters published in outlets like The New York Time...

Andrew and Justin catch up after a Super Bowl that was chock full of various AI ads. The two touch on the ongoing feud between Anthropic and OpenAI over ads, partially fought out, ironically enough, in those very same ad campaigns. After talking through OpenAI's own Codex ad and the launch of its standalone Mac app, the two tackle compute constraints, Elon's pivot to the moon, and more. Chapters 0...

Andrew and Justin talk through the recent viral success of Clawdbot, an open-source AI personal assistant that's taken the web by storm over the weekend. After Justin debates installing it on a Mac Mini, the two discuss the other Claude — namely, Claude's founder Dario Amodei, who continues to issue "dire warnings" over the rise of AI. Chapters 00:00 - Intro 00:47 - Clawdbot 09:26 - Dario Amodei's...

Andrew and Justin walk through OpenAI CFO Sarah Frier's latest blog post digging into the company's annual revenue compared to its current demand, alongside some thoughts shared by Sarah with Andrew on the official OpenAI Podcast. The two also dig into OpenAI's announcement of ads in its free tier and what it might for the future of the platform before digging into some of the discovery coming out...

Andrew and Justin dive into the two big stories facing the world of AI this week. First, ChatGPT Health is here, designed to deliver specific answers tailored to healthcare and wellness. Is this the future of visiting a doctor, and what concerns face this sort of technology moving forward? Then they turn to Google, who are partnering with Apple to provide models for the company's next-gen Siri ass...

Andrew and Justin talk through Nvidia's $20 billion deal to both acquire the talent and license the tech offered by Groq, a chip company focused on lowering inference costs. The two also offer their AI predictions for 2026 and ponder whether Jony Ive and Sam Altman's OpenAI hardware project will show up before year's end. Chapters 00:00 - Intro 00:30 - Nvidia and Groq 16:17 - 2026 Predictions 23:1...

Andrew and Justin tackle the biggest question surrounding AI right now: are we in a bubble? The two discuss how the market reacts to AI-centric news, slowdowns in hiring, and why product matters more than just simple models. Plus, a little talk on the rumor of ads finding their way to ChatGPT's free tier, and Thrive Capital's investment in OpenAI. Chapters 00:00 - Intro 00:45 - Is there an AI bubb...

Andrew and Justin dive into the launch of Atlas, OpenAI's new browser set to square off with Chrome in the race to an AI-centric web client. The duo also breaks down Google's flaws in building out its AI toolset, Meta's recent layoffs from its own AI team, and the joys of using Sora over the past month. Chapters 00:00 - Intro and Atlas 14:10 - Sora thoughts 21:43 - Google's AI efforts 23:52 - Meta...

Andrew and Justin talk about a busy week's worth of AI news, including the looming launch of ChatGPT's Sora 2. The pair also discuss Google's current successes at AI with Nano Banana and the rise of Gemini to the top of the App Store charts, OpenAI's new Instant Checkout feature in ChatGPT, and dish out some advice on what to focus on when learning AI tools. Chapters 00:00 - Intro 01:16 - Google's...

Andrew and Justin address the growing concerns that AI development could result in an explosion of job losses. The two work through whether industries heavily impacted by AI could turn towards replacing humans entirely, or if a hybrid approach brings about an improved society for all. They also address some recent AI news, including Nvidia's investment in OpenAI and Meta's recent live demo failure...

Following Ezra Klein's editorial celebration of ChatGPT 5 in the NY Times over the weekend, Andrew and Justin break down the reaction to OpenAI's latest model, as well as their own feelings on it. After touching on both the "95%" report out of MIT and the AI 2027 scenario sweeping the web, the two talk about the pro-AI Super PAC started by, among others, Andreessen Horowitz and OpenAI's Greg Brock...

After a busy few weeks, Andrew and Justin reconvene to talk through all of the AI-centric news that has hit your feed over the summer. From the launch of ChatGPT 5 and the subsequent news cycles surrounding personality changes and reliability, to Elon's war against App Store charts and the battle against compute constraints, there's plenty to get through. It's the opposite of whatever an AI Winter...