What does MLOps look like when you are deploying 60 billion machine learning predictions a day?

Maddie Daianu, Head of Data and AI at Intuit Credit Karma, joins the Data Bros to pull back the curtain on one of the most high-volume data environments in FinTech. With a 100-person team serving 140 million members, standard data practices break down.

Maddie shares how her team manages terabytes of daily data on Google Cloud and explains the massive strategic pivot they are undertaking right now: The move from "Information" to "Agency."

What You'll Learn:

Extreme Scale: How to architect a system that handles 80 billion daily predictions without latency.
The Unified Consumer Profile: The hackathon project that unlocked real-time personalization across Credit Karma and TurboTax.
The "Done-For-You" Future: Why they are building an "Agentic Data Layer" to move from recommending financial products to actively managing them for the user.

If you want to know what the future of high-scale AI infrastructure looks like, this is the blueprint.

If you enjoyed this episode, make sure to subscribe, rate, and review it on Apple Podcasts, Spotify, and YouTube Podcasts. Instructions on how to do this are here.

About the Guest(s)

Maddie Daianu is the Head of Data and AI at Intuit Credit Karma, where she leads the teams responsible for AI science, machine learning engineering, data engineering, and the experimentation platform. She brings a background that spans academic research in biomedical engineering and machine learning, and experience at both smaller companies and Meta. Her current focus is on building the data and AI infrastructure that drives highly personalized financial experiences for Credit Karma's 140 million members and contributes to Intuit's broader consumer ecosystem.

Quotes

"The key elements and ingredients of making this app successful is data and AI." - Maddie

"We have and we process and transform multiple terabytes of information daily for our 140,000,000 members every single day." - Maddie

"We have our models that essentially, lead to almost 60,000,000,000 daily predictions for our 140,000,000 member base every single day." - Maddie

"We want to take this to the next level. So Intuit as a whole believes... in creating done for you experiences for our users." - Maddie

"If you don't structure your data in a semantically, well structured way, you are not likely able to provide the most highly relevant and personalized experiences for users." - Maddie

"One thing that we've been building, in the last year or so it's called the unified consumer profile." - Maddie

"Intuit has been investing in tremendously over the last, few years... the generative AI operating system... to move fast and continuously disrupt ourselves, especially in the age of AI." - Maddie

Resources

Connect on LinkedIn:

Websites:

Credit Karma

Tools & Platforms:

BigQuery – Data warehouse for processing multiple terabytes of information daily
Bigtable – Operational serving layer for real-time data access
Vertex AI – Machine learning platform for model training and deployment
Alchemy – Feature online feature store for real-time transformations and aggregations
Generative AI Operating System – Centralized platform for democratizing Gen AI adoption across Intuit products

Products & Services Mentioned:

TurboTax – Tax preparation and filing software
Debt Agent – AI-powered tool for debt consolidation and management assistance
Unified Consumer Profile – Semantic graph depicting financial journey across Credit Karma and TurboTax

The Data Engineering Show is brought to you by firebolt.io and handcrafted by our friends over at: fame.so

Previous guests include: Joseph Machado of Linkedin, Metthew Weingarten of Disney, Joe Reis and Matt Housely, authors of The Fundamentals of Data Engineering, Zach Wilson of Eczachly Inc, Megan Lieu of Deepnote, Erik Heintare of Bolt, Lior Solomon of Vimeo, Krishna Naidu of Canva, Mike Cohen of Substack, Jens Larsson of Ark, Gunnar Tangring of Klarna, Yoav Shmaria of Similarweb and Xiaoxu Gao of Adyen.

Check out our three most downloaded episodes:

Datastar and Hypermedia

netstack.fm

AI Tools as Assistants, Not Crutches

Episode 4 – Datastar and Hypermedia.

The AI-powered Podcast Player