Gradient Dissent: Conversations on AI cover image

Shreya Shankar — Operationalizing Machine Learning

Gradient Dissent: Conversations on AI

CHAPTER

MapReduce

I would recommend getting like a AWS account or something having some easy to cluster setup if you're working with large amounts of data I have my qualms about spark but I mean spark is useful if people know how to use it. MapReduce as a philosophy of processing large amounts ofData is not great because it forces the application developer to reason about record level problems and this is what DBS are really great for. The whole duck DB at least explosion that we see going on of bringing these kinds of large scale do the queries back to the DBMS i'm curious where that's gonna go. okay I mean I really appreciate your kind of open mindedness about sort of like work close and

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner