The Attention Mechanism with Andrew Mayne

The hosts dive into the excitement surrounding ChatGPT 5, discussing its capabilities and mixed reactions. They explore a notable MIT study on AI success rates, along with the implications of a pro-AI Super PAC backed by industry heavyweights. Conversations touch on the urgent need for decentralized AI regulations and the influence of AI on political landscapes. Lastly, there's a light-hearted celebration of achievements, blending humor with insights into the evolving tech narrative.

Andrew and Justin dive into the whirlwind of AI news this summer. They analyze the launch of ChatGPT 5, exploring its personality shifts and the ongoing challenge of user expectations. The conversation takes a turn to touch on Elon's battle in the App Store arena, highlighting the competitive landscape of AI applications. They also delve into the pressing issue of compute constraints, discussing how limited resources impact the development and scaling of innovative AI products. Prepare for an exciting ride through the evolving tech world!

Andrew and Justin tackle Meta's recent push to recruit the best minds working on AI today through any means — mostly monetary — necessary. They also touch on Apple's struggles in this field, OpenAI's recent lawsuit over their new hardware initiative with Jony Ive, and their expectations around whatever Sam and Jony have in the works.00:00 - Meta's AI Recruitment Push12:35 - Looking Back at Meta's Strategy21:00 - Meta's Potential AI Future27:55 - OpenAI io Lawsuit35:30 - OpenAI Hardware Expectations42:02 - Wrap-up Hosted on Acast. See acast.com/privacy for more information.

On this episode, Justin and Andrew break down Andrew’s new role as host of the official OpenAI podcast — including behind-the-scenes insights, why Sam Altman welcomed tough questions, and what it means for transparency in AI. Then, they dive into Tesla’s Robotaxi rollout in Austin, Elon’s sensor philosophy, and what autonomy could mean for accessibility. Finally, they geek out over ByteDance’s shockingly cheap and fast video model, and why the future of animation might cost just a few cents.Chapters00:00 - Intro00:25 - OpenAI Podcast12:05 - Tesla's Robotaxis27:10 - ByteDance's Video Model35:23 - Wrap-up Hosted on Acast. See acast.com/privacy for more information.

The podcast dives into the impact of AI technology on mental health, sparking discussions about ethical responsibilities and the dangers of AI for vulnerable users. It critiques user feedback mechanisms in AI, revealing unintended consequences of overly agreeable responses. The conversation shifts towards the business model behind AI chatbots like ChatGPT and their subscription-based approach. Lastly, it examines how AI influences storytelling and filmmaking, advocating for a balance between human creativity and technological innovation in media production.

In the wake of WWDC, Andrew and Justin convene to discuss whether Apple's lack of AI advancements is spelling a troubling sign for the company's future dominance in the tech landscape. Elsewhere, Justin hates OpenAI's new Advanced Voice Mode and its constant giggling, Meta drops some serious cash to continue funding their AI initiative, and a quick dip into the Elon of it all.Chapters00:00 - Intro01:19 - Xcode and ChatGPT 07:08 - Apple Intelligence and its New Research Paper18:51 - OpenAI's Advanced Voice Mode25:34 - Meta's AI Investment33:31 - Elon40:32 - Wrap-up Hosted on Acast. See acast.com/privacy for more information.

Justin and Andrew dig into a busy news cycle, with Veo 3 stealing the show at Google I/O. After breaking down the company's latest video generation model and some communication challenges facing Anthropic, they arrive at the biggest AI news of the week: OpenAI's hardware tease. With a Jony Ive partnership locked down, Justin and Andrew discuss the legacy of Steve Jobs and how Sam Altman plays into it, what the gadget could actually be, and whether this could be the biggest tech launch since the iPhone.Chapters00:00:00 - Intro00:00:51 - Google I/O and Veo 300:11:37 - Google AI Ultra Subscriptions00:17:45 - Anthropic Controversy00:22:08 - OpenAI and Jony Ive Partnership00:37:50 - Operator o3 update and wrap-up Hosted on Acast. See acast.com/privacy for more information.

Justin and Andrew discuss the challenges Apple faces in the AI landscape in the wake of a blockbuster new report from Bloomberg's Mark Gurman. They explore the decline and failed potential of Siri, the evolving nature of search engines, and the potential future of AI integration in everyday technology. Then the pair turn their attention to the implications of new agentic technologies like Model Context Protocol (MCP), which was featured heavily at Microsoft Build 2025.Chapters00:00 - Intro and Nvidia Stock02:12 - Apple's AI Missteps and Market Position09:47 - Siri's Decline and Apple's AI Vulnerability13:45 - The Future of Search and Apple's Position18:11 - The Impact of AI on Search Engine Dynamics23:41 - MCP: A New Paradigm in AI Interaction30:10 - The Future of Browsers and AI Integration Hosted on Acast. See acast.com/privacy for more information.

Justin and Andrew dive into the growing debate over whether we’ve already crossed the AGI threshold — or if we’ll even know when we do. From Tyler Cowen’s “AGI moment” with OpenAI’s o3 model to the jagged frontier of modern evals, they explore why defining intelligence is more subjective than ever.Chapters00:00 - Intro02:20 - The AGI Moment10:22 - Is o3 or Gemini 2.5 AGI?14:50 - The Pseudosingularity20:16 - Humanity's Last Exam Hosted on Acast. See acast.com/privacy for more information.

Meta announces not one, not two, but three LLaMA 4 models — and somehow the most impressive one isn’t actually available. Andrew and Justin dive into the weird timing of the release, the confusion around Chatbot Arena scores, and why the open-weight community is raising eyebrows. Plus: what does “open” really mean anymore, and are we on the edge of an eval collapse?Chapters00:00 - Intro00:30 - Llama 406:01 - Open Source vs. Open Weight11:54 - AI Monetization21:37 - A Pending Eval Crisis?31:46 - Wrap-up Hosted on Acast. See acast.com/privacy for more information.