
How Discord Stores Trillions of Messages - A deep dive
The Backend Engineering Show with Hussein Nasser
00:00
Can You Hotspot a Partition?
In Cassandra reads are more expensive than writes. Lots of concurrent reads as users interact with servers can hotspot a partition Okay Which we refer to as Imagine it is a hot partition the size of our deaths Is when combined with these access patterns Let to struggle for our cluster. All right with that rant now let's jump into it again in Cassandra Reads are moreexpensive than writes writes are Appended to a commit log as I talked about and written to an in-memory structure called a mint table That is eventually flush to disk reads however Need to query the mem table to potentially and potentially multiple SS tables on this file to find what you're looking for So this is a more expensive operation Many queries
Transcript
Play full episode
Remember Everything You Learn from Podcasts
Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.