Two's Complement

Passing Messages

13 snips
Feb 14, 2025
Dive into the intriguing world of messaging systems where efficiency meets chaos. The hosts tackle the complexities of time synchronization and event collisions, stressing the need for standardized timestamps. Discover the balance between speed and reliability as they share personal experiences in system design. Plus, learn about the challenges of error recovery and fault tolerance in streaming systems, especially in high-stakes environments like finance. And don't miss the entertaining stories of getting stuck in unexpected places!
Ask episode
AI Snips
Chapters
Transcript
Episode notes
ADVICE

Avoid Large Data in Messages

  • Avoid putting large blocks of data, like gigabytes, directly into messages.
  • Instead, store large data elsewhere and send a message with a pointer to its location for efficient processing.
ANECDOTE

Systems Highlighting Messaging Challenges

  • Ben shared building a monitoring system, event trading, and a cryptocurrency exchange as examples of message-based systems.
  • These systems demonstrate different latency and sequencing challenges and architectures in practice.
ADVICE

Use Direct Messaging for Latency

  • For latency-sensitive apps, avoid intermediaries like databases to store messages.
  • Instead, use direct message passing over TCP or reliable multicast to reduce latency.
Get the Snipd Podcast app to discover more snips from this episode
Get the app