The Data Exchange with Ben Lorica cover image

The Data Exchange with Ben Lorica

Versioning and MLOps for Generative AI

Oct 12, 2023
Yucheng Low, CEO of XetHub, talks about managing large-scale ML assets and the challenges of data management. They discuss the need for version control, data reproducibility, and efficient solutions. The podcast covers topics such as GDPR impact on data teams, benefits of openness in data management, and distinguishing features of their tool. They also discuss the importance of deduplication, summaries, and visualization tools, and the unique features of Zetahub's user interface for data versioning and collaboration.
38:35

Episode guests

Podcast summary created with Snipd AI

Quick takeaways

  • Set Hub provides a platform for version control and collaboration on large-scale ML assets, solving the challenges of data and model management.
  • Set Hub offers deduplication, scalability, and access control, allowing for easy migration, collaboration, and informed decision-making during the ML development process.

Deep dives

Set Hub: Managing ML Assets and Version Control

Set Hub, a company co-founded by Yucheng Low, provides a platform that allows for version control and collaboration on large-scale ML assets. Set Hub solves the problem of data and model management, enabling data scientists and ML developers to track and manage different versions of models and data. It allows for easy reproducibility and supports collaboration among team members. Set Hub operates like a git-based back-end, but can handle repositories spanning from terabytes to petabytes of data. It is particularly useful for managing data sets that evolve over time and require multiple versions for analysis and model training.

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode