3min chapter

Gradient Dissent: Conversations on AI cover image

Shreya Shankar — Operationalizing Machine Learning

Gradient Dissent: Conversations on AI

CHAPTER

MapReduce

I would recommend getting like a AWS account or something having some easy to cluster setup if you're working with large amounts of data I have my qualms about spark but I mean spark is useful if people know how to use it. MapReduce as a philosophy of processing large amounts ofData is not great because it forces the application developer to reason about record level problems and this is what DBS are really great for. The whole duck DB at least explosion that we see going on of bringing these kinds of large scale do the queries back to the DBMS i'm curious where that's gonna go. okay I mean I really appreciate your kind of open mindedness about sort of like work close and

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode