Loggregator, gRPC, Diodes (Go Time #61)
Changelog Master Feed
00:00
How to Use GRPC to Reduce Network Latency
Loggerator has the task of ensuring that while we do our best to push messages through you know this distributed network system we will not push back on the application. In fact it won't push back at all and it should be free. We ended up making something called a diode which essentially was a ring buffer that operated purely on atomics and we therefore prioritize new messages over old ones. This enabled us to have buffer data allow for network latency and recover from that while ensuring we didn't push back on consumers or producers rather and still trying to get the most amount of logs we possibly could to our consumers. So recently we've had some downstream consumers of water eaters start to use it
Transcript
Play full episode
