DataTalks.Club cover image

Data Intensive AI - Bartosz Mikulski

DataTalks.Club

00:00

Testing Strategies in Data Engineering

This chapter explores the author's insights on testing methodologies as featured in '97 Things Every Data Engineer Should Know.' It examines the critical role of robust testing in data pipelines to ensure data integrity and discusses the unique challenges of implementing test-driven development within the data engineering landscape. The conversation also highlights practical testing approaches, including the use of Spark, integration tests, and essential checks for data processing accuracy.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app