AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Software Huddle
Serverless Clickhouse with Tyler Wells
Mar 19, 2024
Tyler Wells, CTO and co-founder at Propel, discusses building data platforms at Twilio and Skype. Topics include real-time analytics challenges, Propel's solutions, infrastructure development insights, S3's importance, and the impact of AI on software engineering.
01:12:12
Episode guests
AI Summary
AI Chapters
Episode notes
Podcast summary created with Snipd AI
Quick takeaways
- Propel focuses on efficient data ingestion methods like Snowflake integration, webhooks, and S3 Parquet format for real-time analytics.
- Compute costs are managed as the highest expense, emphasizing readiness and responsiveness while prioritizing stability and performance over scaling intricacies.
Deep dives
Ingestion Methods at Propel
Propel offers various ingestion methods, including direct integration with Snowflake, webhooks for real-time data ingestion, and support for S3 Parquet format. The company initially focused on Snowflake integration due to its reputation as a gold standard for data warehousing. Webhooks allow for immediate data insertion, but throttling can be applied based on request rates. Their approach with S3 Parquet format leverages Clickhouse's native support for this format, ensuring efficient data ingestion and storage.
Get the Snipd
podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any
moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share
& Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode