Software Engineering Radio - the podcast for professional software developers cover image

Episode 424: Sean Knapp on Dataflow Pipeline Automation

Software Engineering Radio - the podcast for professional software developers

00:00

Data Pipelines and ETL - Is There Something in Between?

Every business has a pipeline. So every business then is pulling data out of a OLTP database and putting it in a data warehouse. And what we'll find is oftentimes a good practice is to not perform any radical transformations on that data. It's safer to actually keep a copy of that data and sheep storage, put it in S3GCS Azure Blob store.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app