MLOps.community

Kubernetes, AI Gateways, and the Future of MLOps // Alexa Griffith // #294

Mar 7, 2025

Alexa Griffith, a Senior Software Engineer at Bloomberg, shares her journey in building scalable ML inference platforms and contributing to open-source projects. She discusses the evolution of workflow tools, comparingAirflow with new solutions like CoopFlow and Argo. Highlighting the Envoy AI Gateway, she addresses the challenges of managing AI traffic. Alexa also emphasizes the importance of aligning tech work with business goals, optimizing GPU utilization, and fostering effective communication between teams for successful AI deployments.

51:43

Creator website

Episode guests

Alexa Griffith

AI Summary

AI Chapters

Episode notes

Podcast summary created with Snipd AI

Quick takeaways

Engaging with mentors and participating in high-impact projects significantly enhances career growth and technical contributions in software engineering.

Cross-functional collaboration among diverse engineering teams is crucial for aligning technical solutions with business goals and improving project outcomes.

Deep dives

The Impact of Mentorship in Career Development

Having mentors and working on teams that prioritize solving problems with real business value can significantly accelerate career growth. Mentors help individuals navigate challenges and demonstrate the importance of aligning technical projects with organizational goals. This was especially true for the speaker, who attributed much of her success in open source contributions and software engineering to the guidance and opportunities provided by her mentors. By being involved in high-impact projects, she was able to champion open source efforts that directly benefited her employers.

Intro

2min

Adventures in Japan: Skiing, Travel Tips, and Jet Lag Solutions

2min

Navigating Airflow and Emerging Workflow Tools

10min

Navigating AI Traffic with Envoy AI Gateway

12min

Exploring Advancements in AI Models and Open Source Contributions

2min

Navigating Open Source: Insights and Strategies

11min

Striking a Balance: Simplicity and Necessity in Project Development

2min

Optimizing GPU Utilization and User Insights

11min

Kubernetes, AI Gateways, and the Future of MLOps // MLOps Podcast #294 with Alexa Griffith, Senior Software Engineer at Bloomberg.

Join the Community: https://go.mlops.community/YTJoinIn Get the newsletter: https://go.mlops.community/YTNewsletter

// Abstract

Alexa shares her journey into software engineering, from early struggles with Airflow and Kubernetes to leading open-source projects like the Envoy AI Gateway. She and Demetrios discuss AI model deployment, tooling differences across tech roles, and the importance of abstraction. They highlight aligning technical work with business goals and improving cross-team communication, offering key insights into MLOps and AI infrastructure.

// Bio

Alexa Griffith is a Senior Software Engineer at Bloomberg, where she builds scalable inference platforms for machine learning workflows and contributes to open-source projects like KServe. She began her career at Bluecore working in data science infrastructure, and holds an honors degree in Chemistry from the University of Tennessee, Knoxville. She shares her insights through her podcast, Alexa’s Input (AI), technical blogs, and active engagement with the tech community at conferences and meetups.

// Related LinksWebsite: https://alexagriffith.com/

Kubecon Keynote about Envoy AI Gateway https://www.youtube.com/watch?v=do1viOk8nok

~~~~~~~~ ✌️Connect With Us ✌️ ~~~~~~~

Catch all episodes, blogs, newsletters, and more: https://go.mlops.community/TYExplore

Join our slack community [https://go.mlops.community/slack]

MLOps Swag/Merch: [https://shop.mlops.community/]

Connect with Demetrios on LinkedIn: /dpbrinkm

Connect with Alexa on LinkedIn: /alexa-griffith