Monday Morning Data Chat cover image

Monday Morning Data Chat

#117 - Designing Massive Distributed Systems at LinkedIn w/ Felix GV

Mar 16, 2023
01:00:07
Snipd AI
In this podcast, Felix GV discusses designing massive distributed systems at LinkedIn, including the Venice open-source project. He also shares his thoughts on designing software for a multi-planetary civilization, offering a unique perspective on the future of technology.
Read more

Podcast summary created with Snipd AI

Quick takeaways

  • The Venice project at LinkedIn successfully transitioned batch processing system successes into stream processing, enhancing ML features for improved user experience.
  • Venice's future plans include decoupling from Kafka, advancing conflict resolution capabilities, and enhancing flexibility for diverse data processing needs.

Deep dives

Origin and Ideation of the Venice Project

The Venice project originated from the idea of mirroring the success of Voldemort, a batch processing system, into the stream processing domain. The project commenced in 2016 after facing initial delays due to competing priorities. By the end of 2016, Venice was fully operational, marking a year of intensive development and ensuring a smooth transition from Voldemort.

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode