Developer Voices

DuckDB And The Burden of Success (with Hannes Mühleisen)

83 snips
Aug 26, 2026
Hannes Mühleisen, co-creator of DuckDB and co-founder of DuckDB Labs, is a database researcher and engineer. He walks through making DuckDB extensible to dodge unwanted PRs, why they rewrote SQL parsing with a PEG-based pluggable parser, the design of the Quack wire protocol, and the DuckLake approach to metadata. He also explains why DuckDB Labs joined AWS and how governance and resources changed.
Ask episode
AI Snips
Chapters
Transcript
Episode notes
INSIGHT

Most Database Protocols Are Terrible For Analytics

  • Existing DB wire protocols (Postgres, MySQL, etc.) are inefficient for analytics because they send per-row type/metadata and many tiny messages.
  • Hannes' VLDB work showed piping raw data is often far faster than bespoke protocols.
ADVICE

Fix Recurring Workarounds With Structural Changes

  • If users repeatedly implement the same workaround, add a structural solution rather than telling them they're 'holding it wrong.'
  • DuckDB added warnings and features (e.g., deterministic-order warnings) when patterns recurred in reports.
ADVICE

Offer Pluggable Auth Callbacks Not Built-In RBAC

  • Expose authentication and authorization hooks so deployments can implement enterprise policies without bloating core engine.
  • DuckDB provides SQL-level callback functions for auth and per-query authorization checks.
Get the Snipd Podcast app to discover more snips from this episode
Get the app