What Is the High Level Architecture of a Pipeline Automation Engine?

The most common thing we see pretty much uniformly is it's a scheduler that runs some form of jobs with some notion of a DAG. This is I think really word the biggest difference in different technologies comes out is it really comes down to how much state do you maintain? We're starting to see things get a little bit better, more generically across the industry around some level of maintaining that there's a notion of data.