Data Engineering Podcast

Tobias Macey
undefined
52 snips
Sep 18, 2025 • 53min

From RAG to Relational: How Agentic Patterns Are Reshaping Data Architecture

Mark Brooker, VP and Distinguished Engineer at AWS, dives into how agentic workflows are revolutionizing database infrastructure. He shares insights on why agents demand serverless, elastic databases and discusses the shift from traditional data models to vectors and relational databases. Mark explores the significance of tools like D-SQL for managing global agent workloads and highlights real-world applications, such as agent-driven SQL fuzzing. He also emphasizes the need for improved identity and authorization in our evolving data landscape.
undefined
57 snips
Sep 10, 2025 • 1h 11min

Duck Lake: Simplifying the Lakehouse Ecosystem

Hannes Mühleisen and Mark Raasveldt, key figures behind DuckDB, dive into their latest project, Duck Lake, aiming to simplify the lakehouse ecosystem. They discuss how Duck Lake stands out with its unified SQL database, making metadata management a breeze. The duo shares their vision for decentralized processing, local-first data architecture, and benefits like data inlining and encryption. They also touch on its seamless integration with existing systems, showcasing how it can transform data workflows and enhance user experiences.
undefined
67 snips
Sep 1, 2025 • 1h 7min

Aligning Business and Data: The Essential Role of Data Modeling

Serge Gershkovich, Head of Product at SQL DBM and a Snowflake data expert, dives into the socio-technical aspects of data modeling. He emphasizes that effective data modeling is crucial for aligning business needs with technical structures, debunking myths about its importance. The discussion explores challenges in complex environments and the evolving role of AI in data management. Serge advocates for collaboration between business teams and data professionals, highlighting how clear communication can enhance trust and mitigate issues related to data quality.
undefined
16 snips
Aug 26, 2025 • 51min

From Academia to Industry: Bridging Data Engineering Challenges

In this engaging discussion, Professor Paul Groth from the University of Amsterdam shares his expertise in AI systems and intelligent data engineering. He dives into the evolution of data provenance and lineage, illustrating its significance in today's workflows. Paul also highlights the transformative impact of large language models on knowledge graph construction and data integration. The conversation addresses the synergy between academia and industry, emphasizing human-AI collaboration and the need for tailored data management solutions.
undefined
Aug 18, 2025 • 1h 1min

High Performance And Low Overhead Graphs With KuzuDB

Prashanth Rao, an AI engineer at KuzuDB, delves into the cutting-edge features of their embeddable graph database. He explains how KuzuDB tackles performance issues with innovative columnar storage and unique join algorithms. The conversation reveals KuzuDB's potential for enhancing graph applications, especially in edge computing and ephemeral workloads. Prashanth also discusses the growing interest in graph databases for AI integration and how Kuzu can seamlessly work with other data formats like Iceberg and Parquet.
undefined
84 snips
Aug 12, 2025 • 1h 11min

Bridging Data and Decision-Making: AI's Role in Modern Analytics

Lucas Thelosen and Drew Gilson, co-founders of Gravity, delve into the transformative impact of AI in data analytics. They discuss their creation of Orion, an autonomous data analyst designed to bridge data and decision-making. The conversation highlights how AI democratizes access to data insights for businesses of all sizes, allowing data analysts to focus on strategic tasks. They also emphasize the importance of accuracy and trustworthiness in AI-driven workflows, sharing insights on how companies can cultivate a data-driven culture.
undefined
71 snips
Aug 5, 2025 • 50min

From Bits to Tables: The Evolution of S3 Storage

In this discussion, Andy Warfield, an Amazon storage enhancement expert, dives into the evolution of S3 storage. He explores the revolutionary functionalities of S3 Tables and Vectors, crucial for modern data management and analytics. Andy shares insights on how customer feedback has shaped these developments, improving performance for AI workloads. He also discusses the innovative applications of these features in industries like genomics and finance, along with the technical challenges faced in integrating advanced data types.
undefined
53 snips
Jul 28, 2025 • 52min

Revolutionizing Python Notebooks with Marimo

In this conversation, Akshay Agrawal, Co-founder and CEO of Marimo, introduces a groundbreaking open-source Python notebook environment. He tackles the drawbacks of traditional Jupyter notebooks, such as hidden states, and showcases Marimo’s reactive execution model and improved interactivity. Akshay also discusses the tool's capability to seamlessly integrate data apps, compared to other platforms like Jupyter and Streamlit. The talk highlights the technical architecture, community-driven development, and exciting future plans, including AI enhancements, aiming to revolutionize data workflows.
undefined
20 snips
Jul 21, 2025 • 55min

Warehouse Native Incremental Data Processing With Dynamic Tables And Delayed View Semantics

Dan Sotolongo, a principal engineer at Snowflake, shares insights on simplifying data engineering through incremental data processing and delayed view semantics. He dives into the complexities of managing evolving datasets in cloud warehouses, discussing how these concepts optimize resource use and reduce latency. The conversation contrasts traditional batch systems with dynamic tables and streaming solutions, emphasizing the need for a unified framework for semantic guarantees in data pipelines, and highlights the ongoing innovations in data integration and maintenance.
undefined
29 snips
Jul 15, 2025 • 52min

Streamlining Data Pipelines with MCP Servers and Vector Engines

Kacper Łukawski, a Senior Developer Advocate at Qdrant, specializes in vector databases for large language models. He dives into transforming unstructured data into valuable insights through semantic search and retrieval-augmented generation. Kacper explains the integration of MCP servers for optimizing data pipelines and discusses the challenges of managing embeddings. He also highlights innovative applications in coding practices and the complexities of vector search, offering practical advice on fine-tuning models and reducing costs for enhanced search quality.

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app