Manage Projects With pyproject.toml & Explore Polars LazyFrames

46 snips

Mar 14, 2025

In this engaging discussion, Christopher Trudeau, a regular Python enthusiast, shares insights on simplifying Python project management using a pyproject.toml file. He explains how this configuration file helps streamline dependencies and builds. The conversation also dives into Polars' LazyFrames, emphasizing their efficiency by storing query plans instead of data. Listeners are treated to a roundup of community news, including a build tutorial for a to-do app and recommendations for influential tech literature, enriching their Python experience.

Ask episode

AI Snips

Chapters

Books

Transcript

Episode notes

ADVICE

Python Project Management

Manage Python projects effectively with a single pyproject.toml file.
This simplifies configuration, dependencies, and builds, as shown in Ian Currie's Real Python tutorial.

INSIGHT

Polars LazyFrames

Polars LazyFrames store a query plan instead of actual data, leading to efficient data processing.
This allows for optimization and handling of large datasets by processing only necessary data.

ANECDOTE

Plane Reading

Christopher Trudeau recounts reading "The Cuckoo's Egg" on a plane, finding it insightful but lengthy.
A fellow passenger validated his opinion, agreeing a summary would have sufficed.

Get the Snipd Podcast app to discover more snips from this episode

Get the app

Django in Action

Christopher Trudeau

In 'Django in Action', readers learn to build a complete multi-user website from scratch, covering topics like reusable templates, data management, Django Admin, and leveraging third-party libraries. The book is designed for new Django developers with basic Python and HTML knowledge, offering a comprehensive introduction to Django's core concepts.

Gödel, Escher, Bach

An Eternal Golden Braid

Douglas Hofstadter

This book by Douglas Hofstadter is a comprehensive and interdisciplinary work that explores the interrelated ideas of Kurt Gödel, M.C. Escher, and Johann Sebastian Bach. It delves into concepts such as self-reference, recursion, and the limits of formal systems, particularly through Gödel's Incompleteness Theorem. The book uses dialogues between fictional characters, including Achilles and the Tortoise, to intuitively present complex ideas before they are formally explained. It covers a wide range of topics including cognitive science, artificial intelligence, number theory, and the philosophy of mind, aiming to understand how consciousness and intelligence emerge from formal systems[2][4][5].

The Philosophy of Software Design

null

John Osterholt

The Mythical Man-Month

Essays on Software Engineering

Frederick P. Brooks

In this book, Frederick P. Brooks discusses several key issues in software engineering, most notably 'Brooks's Law,' which states that adding manpower to a late software project makes it later. The book explores the complexities of large programming projects, the difficulties in measuring work in 'man-months,' and the importance of effective communication and team management. It also includes insights from Brooks's experience managing the development of IBM's System/360 and OS/360.

The Cuckoo’s Egg

Tracking a Spy Through the Maze of Computer Espionage

Clifford Stoll

In this book, Clifford Stoll recounts his unexpected adventure as a computer systems manager at the Lawrence Berkeley National Laboratory. A 75-cent accounting error leads him to discover an unauthorized user on the system, later identified as a hacker named 'Hunter' who was stealing sensitive military information. Stoll's one-man investigation involves a high-stakes game of deception, broken codes, satellites, and missile bases, eventually gaining the attention of the CIA. The book details the early days of cybersecurity, the challenges of persuading government agencies to cooperate, and the race against time to safeguard sensitive information from falling into the wrong hands.

The Rust Programming Language

Carol Nichols

Steve Klabnik

This book is the official guide to Rust, an open-source systems programming language. It covers everything from the basics of creating functions, choosing data types, and binding variables to advanced concepts such as ownership, borrowing, lifetimes, error handling, and fearless concurrency. The book includes concept chapters and project chapters, where readers apply what they have learned by building small programs, including a number-guessing game, a Rust implementation of a command line tool, and a multithreaded server. It emphasizes Rust’s ability to provide low-level control without the traditional risks of crashes or security holes, making it suitable for a wide range of programming tasks, from CLI apps to web servers.

Zen and the Art of Motorcycle Maintenance

Robert Pirsig

This classic novel by Robert M. Pirsig is a personal and philosophical odyssey that delves into the author's search for meaning. The narrative follows a father and his son on a summer motorcycle trip from the Midwest to California, intertwining a travelogue with deep philosophical discussions. The book explores the concept of 'quality' and how it informs a well-lived life, reconciling science, religion, and humanism. It also touches on the author's own struggles with his past and his philosophical quest, making it a touching and transcendent exploration of human experience and endeavor.

Automate the Boring Stuff with Python

Practical Programming for Total Beginners

Al Sweigart

This book teaches readers how to use Python to write programs that automate tasks such as searching for text in files, creating and updating Excel spreadsheets, parsing PDFs and Word documents, web scraping, and sending email notifications. It is designed for complete beginners and focuses on practical tasks rather than theoretical computer science concepts. The book includes step-by-step instructions, practice projects, and resources like video courses and an embedded interpreter on the accompanying website.

Snow Crash

Neal Stephenson

Published in 1992, 'Snow Crash' is a science fiction novel by Neal Stephenson that delves into a future where the United States has fragmented into corporate city-states and the internet has evolved into a virtual reality called the Metaverse. The story follows Hiro Protagonist, a pizza delivery driver and part-time hacker, and Y.T., a teenage skateboard courier, as they navigate a complex world threatened by a mysterious computer virus and a powerful drug known as Snow Crash. The novel explores themes of history, linguistics, anthropology, and computer science, and is noted for its prescient vision of the metaverse and its influence on Silicon Valley innovators[2][3][5].

The Phoenix project

Lambeth London Borough Council

In this novel, Gene Kim, Kevin Behr, and George Spafford tell the story of Bill, an IT manager at Parts Unlimited, who is tasked with turning around the company's failing IT department. The book delves into the challenges of IT management, the importance of DevOps practices, and how these practices can lead to significant improvements in efficiency, reliability, and customer satisfaction.

Python crash course

a hands-on, project-based introduction to programming

Eric Matthes

Python Crash Course is a project-based introduction to programming that covers general programming concepts, Python fundamentals, and problem-solving techniques. The book includes practical projects such as creating games, data visualizations, and web applications. It is designed for beginners to learn Python quickly and effectively.

Shop class as soulcraft

an inquiry into the value of work

Matthew Crawford

Matthew B. Crawford

In 'Shop Class as Soulcraft,' Matthew B. Crawford argues that the manual trades offer a unique form of intellectual and personal satisfaction. He critiques modern society's emphasis on 'knowledge work' and the devaluation of manual labor, highlighting the cognitive demands and personal fulfillment that come from working with one's hands. Crawford draws on his own experiences as a motorcycle mechanic and philosopher to illustrate the importance of craftsmanship, self-reliance, and the integration of thinking and doing in meaningful work. The book challenges consumerist culture and advocates for a more humane economy that values and rewards meaningful labor[1][3][4].

Open Source Licensing

Lawrence Rosen

This book provides a detailed explanation of open source licensing, covering intellectual property laws, leading licenses like GPL and Apache, and strategies for choosing the right license for projects. It also addresses legal issues, business models, and risks associated with open source software deployment.

Digital Fortress

Dan Brown

Digital Fortress is a thriller by Dan Brown that explores the themes of government surveillance and civil liberties through the lens of cryptography. The story revolves around the NSA's struggle with an unbreakable code created by Ensei Tankado, which could cripple U.S. intelligence if released. The novel follows Susan Fletcher, the NSA's head cryptographer, as she navigates a web of deceit and betrayal to save the agency and her country.

The Little Schemer

Fourth Edition

Daniel P. Friedman

The Little Schemer is a unique and engaging introduction to the Scheme programming language. It uses a conversational and problem-solving approach, guiding readers through a series of exercises and puzzles. The book's focus on recursion and functional programming makes it a valuable resource for those seeking to deepen their understanding of these concepts. Its playful and interactive style makes learning fun and engaging. The book's emphasis on problem-solving and its focus on building a strong foundation in functional programming make it a valuable resource for both beginners and experienced programmers.

I Hate the Internet

Jarett Kobek

I Hate the Internet is a satirical novel by Jarett Kobek that explores the consequences of the digital boom on individuals and society. Set in San Francisco in 2013, it follows a group of friends navigating a world where social media and tech companies dominate, leading to gentrification and social upheaval. The novel critiques modern society's reliance on technology and the exploitation of intellectual property.

Dreaming in Code

Two Dozen Programmers, Three Years, 4,732 Bugs, and One Quest for Transcendent Software

Scott Rosenberg

Dreaming in Code chronicles the development of Chandler, an open-source personal information manager, highlighting the complexities and challenges faced by its team. The book delves into software development philosophy, methodology, and process, offering insights into why software projects often encounter difficulties. It combines narrative storytelling with explanations of software engineering principles, making it accessible to both technical and non-technical readers.

Fluent Python

Clear, Concise, and Effective Programming

Luciano Ramalho

Fluent Python by Luciano Ramalho is a detailed guide that explores Python's advanced features, including data structures, functions, object-oriented programming, control flow, and metaprogramming. It helps readers become proficient in writing efficient, readable, and Pythonic code. The book is structured into five parts, each focusing on a different aspect of Python programming, making it a valuable resource for intermediate to advanced Python developers.

Learn to Code by Solving Problems

Daniel Zingaro

This book provides a hands-on approach to learning Python by solving problems from real coding competitions. It covers core Python features, data structures, algorithms, and problem-solving strategies, helping readers develop a strong foundation in programming.

Practices of the Python Pro

Dane Hillard

Practices of the Python Pro teaches developers how to create clean, maintainable, and extensible software using Python. The book covers essential software development practices such as separation of concerns, abstraction, and testing, providing examples and exercises to help developers improve their coding skills. It is designed for readers familiar with the basics of Python or another object-oriented language.

The Quick Python Book

A fast-paced introduction to Python for intermediate developers

Naomi Ceder

The Quick Python Book provides a fast-paced introduction to Python, focusing on its syntax, data structures, object-oriented programming, and common libraries. The fourth edition includes coverage of generative AI tools like Copilot and Google Colab, making it ideal for developers looking to enhance their Python skills with AI integration.

Django for Beginners, APIs, and Professionals

null

William S. Vincent

Daemon

Daniel Suarez

In 'Daemon,' Daniel Suarez explores the aftermath of the death of Matthew Sobol, a brilliant game designer who leaves behind a sophisticated and autonomous computer program. This daemon, activated by Sobol's obituary, begins to manipulate and control various systems, recruiting real-world agents and creating advanced devices to achieve its goals. The story follows characters such as Detective Pete Sebeck and Jon Ross as they try to understand and stop the daemon, which is designed to reshape society according to Sobol's vision. The novel critiques the over-reliance on technology and raises questions about control, autonomy, and the potential dangers of advanced technological systems[2][5][6].

Python Automation Cookbook

Explore the world of automation using Python recipes

Jaime Buelta

The Python Automation Cookbook provides step-by-step instructions for automating monotonous tasks using Python. It covers topics such as web scraping, data wrangling, report generation, and email marketing, making it suitable for developers and non-technical professionals alike. The book includes recipes for tasks like creating web applications, generating reports with graphs, and automating marketing campaigns.

Refactored Databases

Scott Ambler

Mark Lyons

How can you simplify the management of your Python projects with one file? What are the advantages of using LazyFrames in Polars? Christopher Trudeau is back on the show this week, bringing another batch of PyCoder’s Weekly articles and projects.

We share a recent Real Python tutorial by Ian Currie about managing projects with a pyproject.toml file. This file simplifies Python project configuration by unifying package setup, managing dependencies, and streamlining builds.

Christopher continues his exploration of the Polars library by covering another Real Python tutorial about working with LazyFrames. He describes how LazyFrames don’t contain data but instead store a set of instructions known as a query plan.

We also share several other articles and projects from the Python community, including a news roundup, building a to-do app with Python and Kivy, working with DuckDB directly instead of using a DataFrame library, a discussion on fiction and nonfiction books about computer science, a terminal visual effects engine, and a full-stack platform for interactive data apps.

Course Spotlight: Everyday Project Packaging With pyproject.toml

In this Code Conversation video course, you’ll learn how to package your everyday projects with pyproject.toml. Playing on the same team as the import system means you can call your project from anywhere, ensure consistent imports, and have one file that’ll work for many build systems.

Topics:

00:00:00 – Introduction
00:02:00 – Happy Pi Day!
00:02:15 – Follow-up: Is BDD Dying?
00:03:32 – Django security releases issued: 5.1.7, 5.0.13 and 4.2.20
00:04:01 – Django 5.2 Beta 1 Released
00:04:11 – DjangoCon Africa Aug 2025 CFP
00:04:29 – Launching the PyCon US 2025 Schedule
00:04:48 – PyPy v7.3.19 Release
00:05:06 – Poetry 2.0.0 Released
00:05:34 – How to Manage Python Projects With pyproject.toml
00:12:10 – Build a To-Do App With Python and Kivy
00:16:22 – Mastering DuckDB When You’re Used to pandas or Polars
00:21:08 – Video Course Spotlight
00:22:42 – How to Work With Polars LazyFrames
00:27:41 – Fiction/Non-Fiction Books on the Topic of CS?
00:42:28 – preswald: Full-Stack Platform for Interactive Data Apps
00:45:52 – terminaltexteffects: Terminal Visual Effects Engine
00:47:59 – Thanks and goodbye

Follow-up:

News:

Django security releases issued: 5.1.7, 5.0.13 and 4.2.20 | Weblog | Django
Django 5.2 Beta 1 Released
DjangoCon Africa Aug 2025, Arusha, Tanzania, (Call for Proposals)
Launching the PyCon US 2025 Schedule – This post summarizes the schedule for PyConUS, including a summary of the keynote speakers, and updates on conference swag.
PyPy v7.3.19 Release
Poetry 2.0.0 Released

Show Links:

How to Manage Python Projects With pyproject.toml – Learn how to manage Python projects with the pyproject.toml configuration file. In this tutorial, you’ll explore key use cases of the pyproject.toml file, including configuring your build, installing your package locally, managing dependencies, and publishing your package to PyPI.
Build a To-Do App With Python and Kivy – “In this tutorial, you’ll go through a series of steps to build a basic To-Do app with Python, SQLite, and Kivy.”
Mastering DuckDB When You’re Used to pandas or Polars – Why use DuckDB / SQL at all if you’re used to DataFrames? This article makes the case for some reasons why, and shows how to perform some operations which in DataFrames are basic but in SQL aren’t necessarily obvious.
How to Work With Polars LazyFrames – In this tutorial, you’ll gain an understanding of the principles behind Polars LazyFrames. You’ll also learn why using LazyFrames is often the preferred option over more traditional DataFrames.

Discussion:

Project:

Additional Links:

Books Mentioned by Mr. Trudeau:

“The Cuckoo’s Egg” by Clifford Stoll
“Mythical Man Month” by Frederick Brooks
“Phoenix Project” by Gene Kim
“Dreaming in Code” by Scott Rosenberg
“Digital Fortress” by Dan Brown
“Godel Escher, Bach” by Douglas Hofstadlter
“A Philosophy of Software Design” by John Ousterhout’s
“I Hate The Internet” by Jarret Kobek
“Snow Crash” by Neal Stephenson
“Automate the Boring Stuff with Python” by Al Sweigart
“Django In Action” by Christopher Trudeau
“Refactoring Databases” by Scott W Ambler and Pramod J Sadalage
“The C Programming Language” by Dennis M. Ritchie and Brian W. Kernighan
“Open Source Licensing” by Lawrence Rosen
“The Quick Python Book” by Naomi R. Ceder
“Learn to Code By Solving Problems: A Python Programming Primer” by Daniel Zingaro
“Python Automation Cookbook” by Jaime Buelta

Books Mentioned by Mr. Bailey:

“The Little Schemer” by Daniel P. Friedman
“Zen and the Art of Motorcycle Maintenance” by Robert M. Pirsig
“Shop Class as Soulcraft: An Inquiry into the Value of Work” by Matthew B. Crawford
“Django for Beginners, APIs, and Professionals” by William S. Vincent
“Python Crash Course” by Eric Matthes
“Automate the Boring Stuff With Python” by Al Sweigart
“Fluent Python” by Luciano Ramalho
“Practices of the Python Pro” by Dane Hillard
“Daemon and Freedom™” by Daniel Suarez

Level up your Python skills with our expert-led courses:

Support the podcast & join our community of Pythonistas