

352: Running Lean at Scale
7 snips Oct 25, 2024
Shrinkage isn't just for clothes! A recent database downsizing from four terabytes to under one showcases transformative scaling strategies. The speaker dives into optimizing podcast processing and smart database management, revealing how these tweaks enhance operations and user experience. Tune in for valuable insights on running lean while maintaining growth.
AI Snips
Chapters
Books
Transcript
Episode notes
Database Shrinkage
- Arvid Kahl reduced his production database from 4 terabytes to under 1, impacting PodScan.
- This change was driven by a weekend observation about data ingestion patterns.
Weekend Ingestion Pattern
- Podscan processes 25% more episodes during the week than needed, mainly due to weekend release patterns.
- Arvid Kahl realized this over-indexing on weekdays led to processing potentially less valuable content.
Smart Database Management
- Optimize database queries to reduce reliance on expensive hardware.
- Arvid Kahl uses a small CPU instance with optimized queries, achieving comparable performance.