Is Dataflow the Most Critical Problem Today for Data Engineering?

Apache Beam does a better job of hybridizing this notion of batch and streaming. We've been basically using bubble gum and baling wire to glue together these pipelines. The industry looks very similar to what container orchestration looked like probably four or five years ago, sort of the pre-cubernetes era.