
Episode 424: Sean Knapp on Dataflow Pipeline Automation
Software Engineering Radio - the podcast for professional software developers
00:00
Data Pipelines and ETL - Is There Something in Between?
Every business has a pipeline. So every business then is pulling data out of a OLTP database and putting it in a data warehouse. And what we'll find is oftentimes a good practice is to not perform any radical transformations on that data. It's safer to actually keep a copy of that data and sheep storage, put it in S3GCS Azure Blob store.
Transcript
Play full episode