The Data Engineering Show How Canva's Data Engineers and Analysts Support 55M Active Users
May 11, 2021
Krishna Naidu, a seasoned Data Engineer at Canva with 15 years of experience, dives into the company's phenomenal growth and the immense data challenges it faces with 55 million users. He shares insights on transforming their data infrastructure, including migrating to Snowflake for enhanced management. The discussion highlights boosting analyst productivity with isolated development environments and evolving collaboration between engineers and analysts. Krishna emphasizes the importance of SQL skills and innovative trends in data streaming, making it a must-listen for data enthusiasts.
AI Snips
Chapters
Transcript
Episode notes
Data Stack with Lake and Warehouse
- Canva uses a data lake with Delta format alongside a Snowflake data warehouse for enriched analytics.
- Third-party data integration is more manageable in the warehouse due to technical and operational reasons.
Celebrating Marketing Attribution Success
- Marketing attribution was a big project celebrated with pizza and axe throwing at Canva.
- This project allowed flexible attribution models, improving marketing insights significantly.
PR Environments via Snowflake Cloning
- Snowflake's cloning enables creating isolated environments per pull request for analysts.
- This innovation drastically improves analyst productivity and avoids conflicts in shared dev environments.