The podcast discusses topics such as building a CDN, migrating to Neon, analyzing open source dependencies, managing projects with Socket, challenges with Fastly CDN, positive experience with Fly, building and handling logs for a CDN, modern deployment with Nian, exploring managed Postgres and CDNs, making choices when building a CDN, infrastructure of the One Password Cloud, and the potential impact of cookies.
The optimization of reducing the number of queries from 70+ to 15 significantly improved performance.
Exploring the use of read replicas in Neon.tech can further enhance performance by reducing network latency.
The team is considering building their own CDN using Nginx instances on fly.io or exploring partnerships with Cloudflare.
Deep dives
Increased latency due to remote Postgres setup
Migrating to Neon.tech's managed Postgres introduced additional network latency due to the remote setup. This latency can impact the performance of our queries, especially when there are a large number of them.
Reducing latency through query optimization
To mitigate the impact of increased latency, efforts were made to reduce the number of queries our Phoenix app sends to the Postgres database. This optimization, implemented by Jared, reduced the number of queries from 70+ to 15, significantly improving performance.
Considering read replicas for improved performance
It may be worth exploring the use of read replicas in Neon.tech to further enhance performance. By distributing read replicas across different regions, potential network latency issues can be reduced, resulting in faster query execution.
Exploring alternatives to Fastly CDN
Due to ongoing performance issues with Fastly CDN, the team is considering alternative options, such as building our own CDN using Nginx instances deployed globally through the fly.io platform or exploring partnerships with Cloudflare or other CDN providers.
Using One Password for seamless secret management
The podcast episode discusses a new implementation where the application uses the One Password CLI to inject all the secrets it needs at boot time. This eliminates the need to configure secrets in fly.io, simplifying the secret management process. The One Password CLI pulls the secrets from the One Password vault when the application boots up, ensuring that secrets never leave One Password except for being loaded into the app's memory.
Considering building a CDN on fly.io
The podcast episode explores the idea of building a CDN on fly.io. The hosts discuss the benefits and challenges of such an endeavor, including the ability to distribute content worldwide and the potential burden of managing a CDN infrastructure. They consider the need for a CDN and evaluate alternative options such as Cloudflare. They also discuss the possibility of partnering with fly.io to build a simple CDN template for others to use.
Using fly.io and Neon for managed Postgres
The podcast episode highlights the use of fly.io and Neon for managed Postgres database. The hosts discuss their experience with Neon as a managed Postgres solution and how it is integrated with fly.io infrastructure. They mention the partnership between Superbase and fly.io for offering managed Postgres, and express their wish for a closer partnership between OnePassword and fly.io. They also discuss the possibility of using Cloudflare as an alternative and mention the availability of Vercel Postgres, which is powered by Neon.
It’s our 13th Kaizen episode! We’re back from KubeCon, we’re making goals for the year, we’re migrating to Neon & we’re weighing the pros/cons of building our own custom CDN.
Neon – The fully managed serverless Postgres with a generous free tier. We separate storage and compute to offer autoscaling, branching, and bottomless storage.
Fly.io – The home of Changelog.com — Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at fly.io/changelog and check out the speedrun in their docs.