MLOps.community  cover image

MLOps.community

BigQuery Feature Store // Nicolas Mauti // #255

Aug 23, 2024
50:38
Snipd AI
Nicolas Mauti, an MLOps Engineer from Lyon, shares his expertise in transforming BigQuery into a powerful feature management system for AI/ML applications. He discusses the challenges of feature versioning, monitoring, and data quality that his team overcame at Malt. The conversation explores how separating feature creation from model coding streamlined their workflows and enhanced performance. Nicolas also emphasizes the importance of effective data lineage tracking and retraining models to ensure consistent accuracy across machine learning projects.
Read more

Podcast summary created with Snipd AI

Quick takeaways

  • Nicolas Mauti discusses how utilizing BigQuery as a feature store centralizes feature computation, enhancing consistency and reliability across data science teams.
  • The implementation of BigQuery decouples feature engineering from model training, allowing data scientists to refine features independently, thereby improving productivity and workflows.

Deep dives

Implementation of BigQuery as a Feature Store

BigQuery was chosen as a feature store to improve the efficiency of model training at the company. Previously, features were created and computed ad hoc, which led to inconsistencies and difficulties in reproducing results across different data science teams. With the implementation of BigQuery, the data scientists now have a centralized table that consolidates feature computations, allowing for reliability and consistency. This shift enables teams to access and use features effectively, organized by timestamps, which simplifies dataset creation for model training.

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode