DataNation: How to Automate Data Quality Work

There's a lot of other ways you can kind of approach this and kind of create these sort of automated pipelines from ingestion to query. And the great thing again, about having something like Project NSC or Dremio Arctic is that since it's cat, it's versioning at the catalog level. So when necessary, you can still just roll back an individual table, if that's all you need.