The Data T Data Orchestration with Hugo Lu
Nov 18, 2024
Hugo Lu, Founder and CEO of Orchestra, shares his journey of creating a unified control plane for data operations. He discusses the challenges of the crowded data space and the complexities of data orchestration. Hugo emphasizes the importance of data governance and enabling a successful data mesh. He also explores the necessity of column-level lineage, predictions for 2025 regarding AI, and how Orchestra leverages AI for insights. Inspired by business leaders, he offers valuable lessons from his entrepreneurial experience.
AI Snips
Chapters
Transcript
Episode notes
From Excel Pain To Data Founder
- Hugo Lu discovered data by trying to automate messy Juul spreadsheets and learning SQL from the data team.
- That practical frustration set him on a path into data engineering and eventually founding Orchestra.
Stitching Eats Data Engineers' Time
- Hugo argues data teams now spend disproportionate time stitching tools instead of pure engineering work.
- He sees orchestration pain as symptomatic of excessive plumbing rather than core data problems.
Outsource Orchestration Infrastructure
- Use a managed orchestration platform to avoid running brittle Airflow/Kubernetes clusters yourself.
- Let the provider handle reliability so your team can focus on data logic, not infra ops.