Mixture of Experts
IBM
Welcome to Mixture of Experts, your weekly deep dive into the ever-evolving landscape of artificial intelligence—bringing you insightful discussions on the latest AI trends, innovations, and their impact on business. From breakthrough research to practical applications, each episode offers a balanced blend of expertise and analysis. Explore how AI is reshaping industries, driving efficiency, and unlocking new opportunities for growth. Whether you're a seasoned professional seeking to stay ahead of the curve or an enthusiast curious about the future of technology, Mixture of Experts delivers the perfect mix of insights and practical knowledge. Tune in and stay informed as we navigate the dynamic intersection of AI and business.
Episodes
Mentioned books
Jul 3, 2024 • 38min
Episode 10: AI Hardware: Training, Inference, Devices and Model Optimization
In Episode 10 of Mixture of Experts we are talking all hardware all the time. Guest host Bryan Casey is joined by Volkmar Uhlig, Chris Hay, and Kaoutar El Maghraoui to explore the intricacies of AI hardware. Is Apple creating a pattern for the industry with their on device and cloud architecture? Tune in to hear the experts debate the details.The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.
Jun 28, 2024 • 39min
Episode 9: Claude 3.5 Sonnet, BIRD-SQL, and the latest in AI Slop
Is shrimp Jesus the best use case of AI content creation? In Episode 9 of Mixture of Experts, guest host Bryan Casey is joined by Shobhit Varshney, Marina Danilevsky, and Michael Glass. The experts analyze both the release Anthropic’s Claude 3.5 and BIRD-SQL. Finally, we talk the latest in AI slop and how it is affecting content creation.The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.
Jun 21, 2024 • 44min
Episode 8: NVIDIA’s Nemotron-4 340B models, Safe Superintelligence Inc. and AI agents
Is there a new major player in the AI space? In Episode 8 of Mixture of Experts, host Tim Hwang is joined by Kush Varshney, Kate Soule, and Maya Murad. First, the experts react to NVIDIA’s Nemotron-4 340B model launch and the future of LLM training. Next, new developments in enterprise agents create a great discussion around the reality of AI agents. Finally, we discuss the launch of a new AI company, Safe Superintelligence Inc. The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.
Jun 14, 2024 • 40min
Apple's WWDC24 reactions and mechanistic interpretability
Is Apple late to the AI game? In Episode 7 of Mixture of Experts, host Tim Hwang is joined by Shobhit Varshney, Skyler Speakman, and Kaoutar El Maghraoui. Today, the experts react to Apple’s slew of AI announcements at WWDC24. Then, part 2 on interpretability this week, as OpenAI released their study mechanistic interpretability. The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.
Jun 7, 2024 • 40min
AI safety, RAG benchmarking and responsible AI at ACM FAccT Conference
What’s the future of AGI? In Episode 6 of Mixture of Experts, host Tim Hwang is joined by Vagner Figueredo de Santana, Marina Danilesky, and Shobhit Varshney. Today, the experts unpack Leopold Aschenbrenner’s AI safety screed, Situational Awareness. We also break down the state of responsible AI amid the annual ACM Fairness, Accountability, and Transparency (FAccT) Conference. Finally, we chat about RAG benchmarking and what it tells us about the industry as a whole.The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.
Jun 7, 2024 • 1min
Introducing Mixture of Experts Podcast
Introducing the Mixture of Experts podcast, your weekly deep dive into the ever-evolving landscape of artificial intelligence—bringing you insightful discussions on the latest AI trends, innovations, and the impact on business. You will hear from a panel of researchers, engineers, data scientists, ethics experts, veteran product leaders and more! Tune in weekly to stay ahead of the AI wave.The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.
May 31, 2024 • 44min
Google’s AI Overviews, Golden Gate Claude, the "whale computer" and scaling laws
How is the market reacting to Google's AI overviews? In Episode 5 of Mixture of Experts, Bryan Casey, our guest host, is joined by Kate Soule, Chris Hay, and Skyler Speakman. Today, our experts revisit a conversation from a previous episode around Google’s AI Overviews and the market reaction. Additionally, they break down Anthropic’s Golden Gate Claude. Finally, what is the “whale computer” and how does it relate to scaling laws?The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.
May 24, 2024 • 38min
Scarlett Johansson, FMTI and Think 2024
What’s going on between Scarlet Johansson and OpenAI? In Episode 4 of Mixture of Experts, host Tim Hwang is joined by Kate Soule, Marina Danilevsky, and Armand Ruiz. Kate explains the future of FMTI, Marina highlights innovations driving the open-source community, and Armand dives into the latest from IBM’s THINK 2024 event. Subscribe for AI updates:https://www.ibm.com/account/reg/us-en/signup?formid=news-urx-52120Learn more about artificial intelligence: https://www.ibm.com/think/artificial-intelligenceThe opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.
May 17, 2024 • 41min
GPT-4o, AI overviews and our multimodal future
In Episode 3 of Mixture of Experts, host Tim Hwang is joined by Shobhit Varshney, Chris Hay, and Bryan Casey for the OpenAI vs. Google showdown. Shobhit analyzes the showcase demos released by OpenAI and Google. Chris breaks down latency and cost in relation to GPT-4 and Gemini 1.5 Flash. Finally, after years of people proclaiming the death of search, Bryan answers the big question: are LLMs forcing the death of Google search? The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.
May 10, 2024 • 46min
The state of open source, InspectorRAGet, and what’s going on with Kolmogorov-Arnold Networks
In Episode 2 of Mixture of Experts, host Tim Hwang is joined by Kush Varshney, Marina Danilevsky, and David Cox. This week, the three AI experts weigh in on the explosion of open source technology and identify how it will shape the market. Kush and Tim produce the single most easy explanation of what’s going on with Kolmogorov-Arnold Networks and why it matters. Finally, we kick it back to the 90s with Inspector RAGet!The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.
