The MLOps Podcast

🏃‍♀️Moving Fast and Breaking Data with Shreya Shankar

Mar 30, 2023

56:56

Creator website

AI Chapters

Episode notes

Introduction

3min

The Importance of Being on Call for ML Engineering

2min

How to Find the Correct Abstraction for Things

2min

Auto Data Validation for ML

3min

The Importance of Correlation in Data Validation

2min

The Use of Partition Summaries in Data Engineering

3min

The Challenges of Automating Clustering

5min

The Scale Problem in ML Monitoring

2min

The Importance of Auto Data Validation in Machine Learning

2min

10.

How to Monitor Unstructured Data Meaningfully

2min

11.

How to Build a Data Validation System for Images

2min

12.

The Counterintuitive Conclusions of ML Practitioners

2min

13.

How to Prioritize Experimentation in an Organization

3min

14.

How to Define an ML Experiment

2min

15.

The Frustration With Machine Learning

2min

16.

How to Measure Success for Machine Learning Teams

3min

17.

The Importance of Metrics for Success in MLOps

2min

18.

The Importance of Execution in a Software Development Environment

2min

19.

The Future of Machine Learning and Envelopes

5min

20.

The Complexity of Chat GPT and RLHF

2min

21.

The Importance of Guardrails in ML and MLOps

4min

22.

How to Clean Your Data

1min

23.

How to Cheaply Ski

3min

In this episode, I had the pleasure of speaking with Shreya Shankar, Ph.D. student at Berkeley RISELab. We chat about auto data validation and MLOps. Shreya shares her insights on several interesting topics, including the challenges of automating the data validation process and how to overcome them. We also discuss what makes organizations able to iterate faster in machine learning, and some predictions about the future of machine learning and MLOps.

Watch the video: https://youtu.be/_hi6--H2Hug Join our Discord community: https://discord.gg/tEYvqxwhah Relevant Links: 📃 Moving Fast with Broken Data – https://arxiv.org/abs/2303.06094v1 🤖 Operationalizing machine learning https://arxiv.org/pdf/2209.09125.pdf 📒 Operationalizing notebooks https://smacke.net/papers/nbslicer.pdf ➡️ Shreya Shankar on LinkedIn – https://www.linkedin.com/in/shrshnk/ ➡️ Shreya Shankar on Twitter – https://twitter.com/sh_reya Recommendation Links: 📺 The Glory – A Korean Revenge Drama – https://www.netflix.com/title/81519223 ⛷️ Go Skiing! 🌐 Check Out Our Website! https://dagshub.com Social Links: ➡️ LinkedIn: https://www.linkedin.com/company/dagshub ➡️ Twitter: https://twitter.com/TheRealDAGsHub ➡️ Dean Pleban: https://twitter.com/DeanPlbn