The Changelog: Software Development, Open Source Kaizen! S3 R2 B2 D2 (Friends)
Aug 11, 2023
Join Gerhard as they dive into the latest enhancements in their applications and backend systems. Experience the hilarity of email chaos during their migration to a distributed setup. Discover the successful switch from AWS S3 to Cloudflare R2, tackling compatibility and cost management. Learn about the integration of GitHub Actions for resilient continuous integration. They also explore AI-powered observability tools and discuss the importance of community engagement through the philosophy of Kaizen.
AI Snips
Chapters
Transcript
Episode notes
Duplicate Email Bug
- Jerod Santo describes a bug where transactional emails, sent via Oban, are being duplicated for a small subset of users.
- This prompted Changelog to support Oban Pro for better visibility into background jobs.
Distributed App
- Changelog.com now runs on two instances, improving resiliency and enabling closer proximity to users.
- Caching issues previously prevented replication, but Oban and Fly.io's Apps V2 resolved this.
Cache Workaround
- Reduce cache times as a temporary workaround for cache inconsistency issues in a multi-node setup.
- Monitor performance impact using tools like Honeycomb to ensure responsiveness remains acceptable.