Cloud Warehouse Cost Optimization (w/ Niall Woodward + Brad Culberson)
The Analytics Engineering Podcast
00:00
How to Optimize Your Warehouse for Faster Processing
The where clause limits you down to only processing that data set. Because the beginning of that query distributes really well. And then what happens is that very large cluster did a good job of filtering, but then the rest of the query gets processed by a few cores because it goes down to one or two files. So that's where you'll see the query kind of stretch out the more processing that gets done after filter there. Now you're stuck down to being running on one core because it's a very small data set at that point.
Transcript
Play full episode
