AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
5min chapter
Scanner.dev with Cliff Crosland
Rustacean Station
How to Store Cold Storage Logs in AWS With Zero Data Transfer Cost
scanner.dev uses the cloud infrastructure for storing the data and some other pieces do you mind to kind of talk about the architecture yeah absolutely so this was really interesting um. So we have a bunch of rust-based containers which will which build index files from the logs that you have in your s3 bucket then we push those index files back into your AWS account into another s3 bucket that you own. We use VPCs and Amazon to have this like direct connection to s3 with no data transfer costs. It's there's just a lot of cool wins it seems where hard work is used way more effectively using this approach and there's not all this extra waste out on the
00:00
Transcript
Episode notes
Get the Snipd
podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any
moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share
& Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode