Mohamed Elgendy, Co-Founder & CEO at Kolena, discusses AI Quality with a focus on tailored quality standards, risk management, and edge deployments. The podcast emphasizes the formation of gold standards for AI, collaboration among AI builders, regulators, and infrastructure firms, and the need for diversification in the tech industry. Elgendy's AI Quality Conference aims to set effective but innovation-friendly quality standards for AI.
Read more
AI Summary
AI Chapters
Episode notes
auto_awesome
Podcast summary created with Snipd AI
Quick takeaways
AI quality depends on specific domain requirements, akin to differences in product quality levels.
Defined gold standards, thorough testing, and adaptability ensure AI products meet intended specifications.
Collaboration among diverse stakeholders is vital for creating effective, industry-specific AI quality standards.
Deep dives
The Vision for AI Quality and Industry Standards
The podcast discusses the vision of creating industry-specific quality standards for AI applications. It highlights the importance of having defined gold standards within each industry, ensuring products are built for their intended specifications and deployed safely. The conversation delves into how different applications within industries have unique quality requirements, emphasizing the need for domain-specific standards.
Challenges in Establishing Gold Standards and Quality Metrics
The episode explores the challenges in establishing gold standards for AI products to avoid a proliferation of ineffective standards. It discusses the importance of defining test cases based on functional requirements and risks, alongside metrics and acceptable guidelines. The host and guest analyze the need for a standardized approach to quality assessment to prevent the creation of redundant or conflicting standards.
Evolution of Industry Awareness and Testing Practices
The conversation traces the evolution of industry awareness and testing practices related to AI quality. It highlights the shift towards systematic testing methodologies and emphasizes the role of infrastructure teams in streamlining quality assessment processes. The episode underscores the significance of collective collaboration among diverse stakeholders to enhance testing coverage and address edge cases effectively.
Promoting Diversity and Collaboration in AI Quality Initiatives
The podcast emphasizes the importance of diversity and collaboration in AI quality initiatives. It showcases efforts to ensure representation from various domains, genders, and backgrounds to foster inclusive discussions. The speakers outline tangible outcomes, such as working groups, to drive industry progress and encourage engagement from a broad spectrum of industry leaders.
Upcoming AI Quality Conference and Tangible Outcomes
The episode anticipates an upcoming AI Quality Conference as a pivotal event to drive industry advancements and define standardized quality norms. It highlights the significance of tangible outcomes, including the formation of working groups for continued collaboration and progress in AI quality initiatives. The hosts emphasize the role of diverse representation, collaborative efforts, and tangible results in shaping the future of AI quality standards.
Mohamed Elgendy is the Co-Founder & CEO at Kolena. Additionally, Mohamed Elgendy has had 1 past job as the Director Of Product and Engineering at Synapse Technology Corporation.
Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/
MLOps podcast #228 with Mohamed Elgendy, Co-founder & CEO of Kolena Inc., What is AI Quality?
// Abstract
Delve into the multifaceted concept of AI Quality. Demetrios and Mo explore the idea that AI quality is dependent on the specific domain, equitable to the difference in desired qualities between a $1 pen and a $100 pen. Mo underscores the performance of a product being in sync with its intended functionality and the absence of unknown risks as the pillars of AI Quality. They emphasize the need for comprehensive quality checks and adaptability of standards to differing product traits. Issues affecting edge deployments like latency are also highlighted. A deep dive into the formation of gold standards for AI, the nuanced necessities for various use cases, and the paramount need for collaboration among AI builders, regulators, and infrastructure firms form the core of the discussion. Elgendy brings to light their ambitious AI Quality Conference, aiming to set tangible, effective, but innovation-friendly Quality standards for AI. The dialogue also accentuates the urgent need for diversification and representation in the tech industry, the variability of standards and regulations, and the pivotal role of testing in AI and machine learning. The episode concludes with an articulate portrayal of how enhanced testing can streamline the entire process of machine learning.
// Bio
Mohamed is the Co-founder & CEO of Kolena and the author of the book “Deep Learning for Vision Systems”. Previously, he built and managed AI/ML organizations at Amazon, Twilio, Rakuten, and Synapse. Mohamed regularly speaks at AI conferences like Amazon's DevCon, O'Reilly's AI conference, and Google's I/O.
// MLOps Jobs board
https://mlops.pallet.xyz/jobs
// MLOps Swag/Merch
https://mlops-community.myshopify.com/
// Related Links
Website: www.kolena.io
Deep Learning for Vision Systems book: https://www.amazon.com/Learning-Vision-Systems-Mohamed-Elgendy/dp/1617296198/
--------------- ✌️Connect With Us ✌️ -------------
Join our slack community: https://go.mlops.community/slack
Follow us on Twitter: @mlopscommunity
Sign up for the next meetup: https://go.mlops.community/register
Catch all episodes, blogs, newsletters, and more: https://mlops.community/
Connect with Demetrios on LinkedIn: https://www.linkedin.com/in/dpbrinkm/
Connect with Mo on LinkedIn: https://www.linkedin.com/in/moelgendy/
Timestamps:
[00:00] Mo's preferred coffee
[00:07] Takeaways
[02:52] See you all in San Francisco on June 25!
[03:04] Please like, share, leave a review, and subscribe to our MLOps channels!
[03:22] AI Quality in Mo's eyes
[08:36] Quality Standards for Software
[14:11] Common Chatbot Functionality
[19:20] The Birth of Innovation
[24:27] Transforming Insights into Standards
[30:27] Testing: One step to quality
[34:58] Two different data points to be harmonized
[37:29] Model cards
[39:12] Test Coverage Democratizes Collaboration
[42:55] Representation matters
[44:50] Wrap up
Get the Snipd podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered podcast player
Listen to all your favourite podcasts with AI-powered features
Discover highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share & Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered podcast player
Listen to all your favourite podcasts with AI-powered features
Discover highlights
Listen to the best highlights from the podcasts you love and dive into the full episode