The Data Engineering Lifecycle

Every business deals in data, but the internet age has ushered in an explosion of the number of different data formats we have to process from a number of different databases to get the job done. Ask any Data Scientist, and they’ll tell you a huge part of their job isn’t data science - it’s data engineering. Acquiring, processing and shipping data, and above all, understanding it. We’ve always had that task in the IT world, but these days it’s a whole discipline.

Today’s podcast sits down with the author of “The Fundamentals Of Data Engineering” to survey the landscape. To understand what data engineering is, and go deep into what a data engineer needs to understand to succeed.