AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Spark and Lakehouse - Are They Going to Coexist?
When i was working on asrdata bricks, i saw these patterns start to emerge with customers. They were looking for ways to eliminate warehouses out of the picture. And you look at spark, right? As your data bricks with spark, that's com into one single driver,. Nove and if you study a patchy spark, like the the fair scheduling within spark, these things are not good for for managing concurrency scale. So we solved these challenges by offering sequal end points that now can load balance between different spark clusters. Also the move to serveles, right you see, you see detabricks making that move right now as well.