DataNation - Podcast for Data Engineers, Analysts and Scientists cover image

33 – CI/CD on the Data Lakhouse

DataNation - Podcast for Data Engineers, Analysts and Scientists

00:00

How to Automate CICD Pipelines

The integration, the plan part could be achieved using the Dremio Arctic catalog or project messy catalog. The idea is you'd want to automate these tests, not just have to continuously run all this SQL manually. So how would you kind of do that automation? There's a lot of different ways you can do that. But again, all it does to matter is just writing the scripts and sending the data to Dremio to do that.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app