The Importance of Automation in Data Engineering

"Data engineering is a means to the end, and people get fascinated about the end that happens eventually," he says. "But it's also something that has to be done at a massive massive scale and it's challenging." The company will need 12 data engineers in 2021 if they are going to build an aggressive new product with big data on top of other systems like chat or CPD for example.