
Episode 424: Sean Knapp on Dataflow Pipeline Automation
Software Engineering Radio - the podcast for professional software developers
00:00
How Many Data Pipelines Do a Business Have?
A data pipeline corresponds to how many data sources you have, whether it's entities coming out of your transactional databases or how you're collecting data from users inside of your applications. Eugene: On a weekly basis, we talk with a lot of different companies out there that don't do data pipelines. And so as you start to peel back a few layers, they really very quickly realize they have pipelines all over the place,. just didn't realize and weren't thinking of them as data pipelines themselves.
Transcript
Play full episode