Software Unscripted cover image

Software Unscripted

Distributed Functions with Jonathan Magen

Jul 18, 2024
Distributed systems scientist Jonathan Magen discusses functional programming in distributed systems using languages like Gleam, Elixir, Ballerina, and Jolie. They cover type inference, big data processing, and the advantages of using purely functional languages in ensuring code reliability.
48:00

Episode guests

Podcast summary created with Snipd AI

Quick takeaways

  • Efficiency in distributed systems may not always improve with task distribution due to coordination inefficiencies.
  • Security aspects are often neglected in formal methods, focusing on functional correctness and absence of race conditions.

Deep dives

Distributed Systems Challenges

Building distributed systems challenges the assumption that distributing tasks automatically leads to performance gains. Research highlights the slowdown caused by coordination protocols, emphasizing that not all algorithms benefit from distribution due to coordination inefficiencies. When data sets exceed single-machine capacities, strategies like computational locality may enhance processing but aren't universally effective. Many machine learning workloads misuse parallelization due to tools' inefficiencies, leading to unnecessary complexity.

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode