Scanner.dev with Cliff Crosland
Rustacean Station
00:00
How to Store Cold Storage Logs in AWS With Zero Data Transfer Cost
scanner.dev uses the cloud infrastructure for storing the data and some other pieces do you mind to kind of talk about the architecture yeah absolutely so this was really interesting um. So we have a bunch of rust-based containers which will which build index files from the logs that you have in your s3 bucket then we push those index files back into your AWS account into another s3 bucket that you own. We use VPCs and Amazon to have this like direct connection to s3 with no data transfer costs. It's there's just a lot of cool wins it seems where hard work is used way more effectively using this approach and there's not all this extra waste out on the
Transcript
Play full episode
Remember Everything You Learn from Podcasts
Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
