AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
3min chapter
#67: High-Performance Computing with serverless at scale with Eoin Shanaghy
Real World Serverless with theburningmonk
Canisis and Kanesusi - How to Scale a Big Data Cluster
With kanesusi, it gives you very strict, predictable concurrency. Every container is going to run one job at a time. The clusters are completely uniform in te the size. So we try to evenly size them by splitting them into more or less similarly sized jobs. And i is in series, and they're using a fixed capacity. It's like four gig abites of ram, a single c pu in a container infor structure,. Or similar inlamda, right? You could figure it for four gig abite, and you're using pretty much one cpu. This makes monitoring and trouble shoting a lot easier actually.
00:00
Transcript
Episode notes
Get the Snipd
podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any
moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share
& Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode