3min chapter

Console DevTools cover image

Cloud infra, with Kurt Mackey (Fly.io) - S04E11

Console DevTools

CHAPTER

The Problem With AWS's Zero Database Latency

We've gotten a ton of, I think one interesting thing that's happened with models is that people have started to care about latency between the user and the server. So if we can shave 200 milliseconds of a model, this has gotten valuable. And so we're adding GPUs, just a hypothesis is people want to do inference close to their users the same way they want to run CPUs. But it also feels like, you know, it's that whole cell of pickaxe and the gold rush thing. Like we're not actually doing anything with this. We're just selling the silicon people happen to want.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode