Streaming a Superset in a Batch Query?

Tyler: Do you think that we can do is streaming a superset? Is that a semantic model where if we get streaming right, as Tyler says, then you'll be able to do everything you can do with batch and more? Chris: I think the sort of answer is theoretically, yes. There are definitely optimizations when you're processing in batch that you can make that you can't in streaming context. But even if it's not the same system, there are questions like, well, maybe it's the same tools. Maybe it's DBT and SQL across both batch and streaming.

Play episode from 09:19

Transcript

Episode notes

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!

Get the app