The Data Stack Show cover image

The Data Stack Show

60: Architecting a Boring Stream Processing Tool With Ashley Jeffs of Benthos

Nov 3, 2021
01:06:54

Highlights from this week’s conversation include:

  • A brief overview of Ashley’s background (2:47)
  • Benthos’ creation and the problems it was meant to address (4:01)
  • Use cases for Benthos (18:25)
  • Key features of Benthos that make it stand out (22:23)
  • Adding windowing to Benthos for fun (29:23)
  • The highs and lows of maintaining an open source project for five years (32:17)
  • The architecture of Benthos (36:23)
  • The importance of ordering in streaming processing (42:15)
  • Gaining traction with an open source project (53:21)
  • Benthos’ blobfish mascot (58:03)
     

The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we’ll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.

RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode