AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Using a Garbage Collector to Create Cash Misses
The key insight here is to think about the things inside of your single computer as, in fact, a distributed system. The issue is the memory is very far away. You have a lot of band width, but the latency is high. And it's essentially the same story here, except the long latencies are all kind f on the scale of what fits inside your small computer. It's like a garbage collecter with a machine designed for creating cash misses, exactly.