The Real Python Podcast Manage Projects With pyproject.toml & Explore Polars LazyFrames
In this engaging discussion, Christopher Trudeau, a regular Python enthusiast, shares insights on simplifying Python project management using a pyproject.toml file. He explains how this configuration file helps streamline dependencies and builds. The conversation also dives into Polars' LazyFrames, emphasizing their efficiency by storing query plans instead of data. Listeners are treated to a roundup of community news, including a build tutorial for a to-do app and recommendations for influential tech literature, enriching their Python experience.
48:43
Python Project Management
- Manage Python projects effectively with a single
pyproject.tomlfile. - This simplifies configuration, dependencies, and builds, as shown in Ian Currie's Real Python tutorial.
Polars LazyFrames
- Polars LazyFrames store a query plan instead of actual data, leading to efficient data processing.
- This allows for optimization and handling of large datasets by processing only necessary data.
Plane Reading
- Christopher Trudeau recounts reading "The Cuckoo's Egg" on a plane, finding it insightful but lengthy.
- A fellow passenger validated his opinion, agreeing a summary would have sufficed.
Get the Snipd Podcast app to discover more snips from this episode
Get the app 1 chevron_right 2 chevron_right 3 chevron_right 4 chevron_right 5 chevron_right 6 chevron_right
Intro
00:00 • 5min
Managing Python Projects with PyProject.toml
05:23 • 15min
Integrating Tools for Data Analysis and Project Packaging in Python
20:10 • 3min
Optimizing Data Processing and Influential Tech Literature
22:43 • 18min
Discovering Book Recommendations and Interactive Data Apps
40:22 • 6min
Exploring Funky Text Animations in the Terminal
45:53 • 3min
Django in Action
Christopher Trudeau
In 'Django in Action', readers learn to build a complete multi-user website from scratch, covering topics like reusable templates, data management, Django Admin, and leveraging third-party libraries.
The book is designed for new Django developers with basic Python and HTML knowledge, offering a comprehensive introduction to Django's core concepts.
Gödel, Escher, Bach
An Eternal Golden Braid
Douglas Hofstadter
This book by Douglas Hofstadter is a comprehensive and interdisciplinary work that explores the interrelated ideas of Kurt Gödel, M.C.
Escher, and Johann Sebastian Bach.
It delves into concepts such as self-reference, recursion, and the limits of formal systems, particularly through Gödel's Incompleteness Theorem.
The book uses dialogues between fictional characters, including Achilles and the Tortoise, to intuitively present complex ideas before they are formally explained.
It covers a wide range of topics including cognitive science, artificial intelligence, number theory, and the philosophy of mind, aiming to understand how consciousness and intelligence emerge from formal systems.
The Philosophy of Software Design
null
John Osterholt
The Mythical Man-Month
Essays on Software Engineering
Frederick P. Brooks
In this book, Frederick P. Brooks discusses several key issues in software engineering, most notably 'Brooks's Law,' which states that adding manpower to a late software project makes it later.
The book explores the complexities of large programming projects, the difficulties in measuring work in 'man-months,' and the importance of effective communication and team management.
It also includes insights from Brooks's experience managing the development of IBM's System/360 and OS/360.
The Cuckoo’s Egg
Tracking a Spy Through the Maze of Computer Espionage
Clifford Stoll
In this book, Clifford Stoll recounts his unexpected adventure as a computer systems manager at the Lawrence Berkeley National Laboratory.
A 75-cent accounting error leads him to discover an unauthorized user on the system, later identified as a hacker named 'Hunter' who was stealing sensitive military information.
Stoll's one-man investigation involves a high-stakes game of deception, broken codes, satellites, and missile bases, eventually gaining the attention of the CIA. The book details the early days of cybersecurity, the challenges of persuading government agencies to cooperate, and the race against time to safeguard sensitive information from falling into the wrong hands.
The Rust Programming Language
Carol Nichols
Steve Klabnik
This book is the official guide to Rust, an open-source systems programming language.
It covers everything from the basics of creating functions, choosing data types, and binding variables to advanced concepts such as ownership, borrowing, lifetimes, error handling, and fearless concurrency.
The book includes concept chapters and project chapters, where readers apply what they have learned by building small programs, including a number-guessing game, a Rust implementation of a command line tool, and a multithreaded server.
It emphasizes Rust’s ability to provide low-level control without the traditional risks of crashes or security holes, making it suitable for a wide range of programming tasks, from CLI apps to web servers.
Zen and the Art of Motorcycle Maintenance
Robert Pirsig
This classic novel by Robert M. Pirsig is a personal and philosophical odyssey that delves into the author's search for meaning.
The narrative follows a father and his son on a summer motorcycle trip from the Midwest to California, intertwining a travelogue with deep philosophical discussions.
The book explores the concept of 'quality' and how it informs a well-lived life, reconciling science, religion, and humanism.
It also touches on the author's own struggles with his past and his philosophical quest, making it a touching and transcendent exploration of human experience and endeavor.
Automate the Boring Stuff with Python
Practical Programming for Total Beginners
Al Sweigart
This book teaches readers how to use Python to write programs that automate tasks such as searching for text in files, creating and updating Excel spreadsheets, parsing PDFs and Word documents, web scraping, and sending email notifications.
It is designed for complete beginners and focuses on practical tasks rather than theoretical computer science concepts.
The book includes step-by-step instructions, practice projects, and resources like video courses and an embedded interpreter on the accompanying website.
Snow Crash
Neal Stephenson
Published in 1992, 'Snow Crash' is a science fiction novel by Neal Stephenson that delves into a future where the United States has fragmented into corporate city-states and the internet has evolved into a virtual reality called the Metaverse.
The story follows Hiro Protagonist, a pizza delivery driver and part-time hacker, and Y.T.
, a teenage skateboard courier, as they navigate a complex world threatened by a mysterious computer virus and a powerful drug known as Snow Crash.
The novel explores themes of history, linguistics, anthropology, and computer science, and is noted for its prescient vision of the metaverse and its influence on Silicon Valley innovators.
The Phoenix project
Lambeth London Borough Council
In this novel, Gene Kim, Kevin Behr, and George Spafford tell the story of Bill, an IT manager at Parts Unlimited, who is tasked with turning around the company's failing IT department.
The book delves into the challenges of IT management, the importance of DevOps practices, and how these practices can lead to significant improvements in efficiency, reliability, and customer satisfaction.
Python crash course
a hands-on, project-based introduction to programming
Eric Matthes
Python Crash Course is a project-based introduction to programming that covers general programming concepts, Python fundamentals, and problem-solving techniques.
The book includes practical projects such as creating games, data visualizations, and web applications.
It is designed for beginners to learn Python quickly and effectively.
Shop class as soulcraft
an inquiry into the value of work
Matthew Crawford
Matthew B. Crawford
In 'Shop Class as Soulcraft,' Matthew B. Crawford argues that the manual trades offer a unique form of intellectual and personal satisfaction.
He critiques modern society's emphasis on 'knowledge work' and the devaluation of manual labor, highlighting the cognitive demands and personal fulfillment that come from working with one's hands.
Crawford draws on his own experiences as a motorcycle mechanic and philosopher to illustrate the importance of craftsmanship, self-reliance, and the integration of thinking and doing in meaningful work.
The book challenges consumerist culture and advocates for a more humane economy that values and rewards meaningful labor.
Open Source Licensing
Lawrence Rosen
This book provides a detailed explanation of open source licensing, covering intellectual property laws, leading licenses like GPL and Apache, and strategies for choosing the right license for projects.
It also addresses legal issues, business models, and risks associated with open source software deployment.
Digital Fortress
Dan Brown
Digital Fortress is a thriller by Dan Brown that explores the themes of government surveillance and civil liberties through the lens of cryptography.
The story revolves around the NSA's struggle with an unbreakable code created by Ensei Tankado, which could cripple U.S.
intelligence if released.
The novel follows Susan Fletcher, the NSA's head cryptographer, as she navigates a web of deceit and betrayal to save the agency and her country.
The Little Schemer
The Little Schemer
Fourth Edition
Daniel P. Friedman
The Little Schemer is a unique and engaging introduction to the Scheme programming language.
It uses a conversational and problem-solving approach, guiding readers through a series of exercises and puzzles.
The book's focus on recursion and functional programming makes it a valuable resource for those seeking to deepen their understanding of these concepts.
Its playful and interactive style makes learning fun and engaging.
The book's emphasis on problem-solving and its focus on building a strong foundation in functional programming make it a valuable resource for both beginners and experienced programmers.
I Hate the Internet
Jarett Kobek
I Hate the Internet is a satirical novel by Jarett Kobek that explores the consequences of the digital boom on individuals and society.
Set in San Francisco in 2013, it follows a group of friends navigating a world where social media and tech companies dominate, leading to gentrification and social upheaval.
The novel critiques modern society's reliance on technology and the exploitation of intellectual property.
Dreaming in Code
Two Dozen Programmers, Three Years, 4,732 Bugs, and One Quest for Transcendent Software
Scott Rosenberg
Dreaming in Code chronicles the development of Chandler, an open-source personal information manager, highlighting the complexities and challenges faced by its team.
The book delves into software development philosophy, methodology, and process, offering insights into why software projects often encounter difficulties.
It combines narrative storytelling with explanations of software engineering principles, making it accessible to both technical and non-technical readers.
Fluent Python
Clear, Concise, and Effective Programming
Luciano Ramalho
Fluent Python by Luciano Ramalho is a detailed guide that explores Python's advanced features, including data structures, functions, object-oriented programming, control flow, and metaprogramming.
It helps readers become proficient in writing efficient, readable, and Pythonic code.
The book is structured into five parts, each focusing on a different aspect of Python programming, making it a valuable resource for intermediate to advanced Python developers.
Learn to Code by Solving Problems
Daniel Zingaro
This book provides a hands-on approach to learning Python by solving problems from real coding competitions.
It covers core Python features, data structures, algorithms, and problem-solving strategies, helping readers develop a strong foundation in programming.
Practices of the Python Pro
Dane Hillard
Practices of the Python Pro teaches developers how to create clean, maintainable, and extensible software using Python.
The book covers essential software development practices such as separation of concerns, abstraction, and testing, providing examples and exercises to help developers improve their coding skills.
It is designed for readers familiar with the basics of Python or another object-oriented language.
The Quick Python Book
A fast-paced introduction to Python for intermediate developers
Naomi Ceder
The Quick Python Book provides a fast-paced introduction to Python, focusing on its syntax, data structures, object-oriented programming, and common libraries.
The fourth edition includes coverage of generative AI tools like Copilot and Google Colab, making it ideal for developers looking to enhance their Python skills with AI integration.
Django for Beginners, APIs, and Professionals
Django for Beginners, APIs, and Professionals
null
William S. Vincent
Daemon
Daniel Suarez
In 'Daemon,' Daniel Suarez explores the aftermath of the death of Matthew Sobol, a brilliant game designer who leaves behind a sophisticated and autonomous computer program.
This daemon, activated by Sobol's obituary, begins to manipulate and control various systems, recruiting real-world agents and creating advanced devices to achieve its goals.
The story follows characters such as Detective Pete Sebeck and Jon Ross as they try to understand and stop the daemon, which is designed to reshape society according to Sobol's vision.
The novel critiques the over-reliance on technology and raises questions about control, autonomy, and the potential dangers of advanced technological systems.
Python Automation Cookbook
Explore the world of automation using Python recipes
Jaime Buelta
The Python Automation Cookbook provides step-by-step instructions for automating monotonous tasks using Python.
It covers topics such as web scraping, data wrangling, report generation, and email marketing, making it suitable for developers and non-technical professionals alike.
The book includes recipes for tasks like creating web applications, generating reports with graphs, and automating marketing campaigns.
Refactored Databases
Scott Ambler
Mark Lyons
How can you simplify the management of your Python projects with one file? What are the advantages of using LazyFrames in Polars? Christopher Trudeau is back on the show this week, bringing another batch of PyCoder’s Weekly articles and projects.
We share a recent Real Python tutorial by Ian Currie about managing projects with a pyproject.toml file. This file simplifies Python project configuration by unifying package setup, managing dependencies, and streamlining builds.
Christopher continues his exploration of the Polars library by covering another Real Python tutorial about working with LazyFrames. He describes how LazyFrames don’t contain data but instead store a set of instructions known as a query plan.
We also share several other articles and projects from the Python community, including a news roundup, building a to-do app with Python and Kivy, working with DuckDB directly instead of using a DataFrame library, a discussion on fiction and nonfiction books about computer science, a terminal visual effects engine, and a full-stack platform for interactive data apps.
Course Spotlight: Everyday Project Packaging With pyproject.toml
In this Code Conversation video course, you’ll learn how to package your everyday projects with pyproject.toml. Playing on the same team as the import system means you can call your project from anywhere, ensure consistent imports, and have one file that’ll work for many build systems.
Topics:
- 00:00:00 – Introduction
- 00:02:00 – Happy Pi Day!
- 00:02:15 – Follow-up: Is BDD Dying?
- 00:03:32 – Django security releases issued: 5.1.7, 5.0.13 and 4.2.20
- 00:04:01 – Django 5.2 Beta 1 Released
- 00:04:11 – DjangoCon Africa Aug 2025 CFP
- 00:04:29 – Launching the PyCon US 2025 Schedule
- 00:04:48 – PyPy v7.3.19 Release
- 00:05:06 – Poetry 2.0.0 Released
- 00:05:34 – How to Manage Python Projects With
pyproject.toml - 00:12:10 – Build a To-Do App With Python and Kivy
- 00:16:22 – Mastering DuckDB When You’re Used to pandas or Polars
- 00:21:08 – Video Course Spotlight
- 00:22:42 – How to Work With Polars LazyFrames
- 00:27:41 – Fiction/Non-Fiction Books on the Topic of CS?
- 00:42:28 – preswald: Full-Stack Platform for Interactive Data Apps
- 00:45:52 – terminaltexteffects: Terminal Visual Effects Engine
- 00:47:59 – Thanks and goodbye
Follow-up:
- Episode #239: Behavior-Driven vs Test-Driven Development & Using Regex in Python
- Is BDD Dying? - Automation Panda
News:
- Django security releases issued: 5.1.7, 5.0.13 and 4.2.20 | Weblog | Django
- Django 5.2 Beta 1 Released
- DjangoCon Africa Aug 2025, Arusha, Tanzania, (Call for Proposals)
- Launching the PyCon US 2025 Schedule – This post summarizes the schedule for PyConUS, including a summary of the keynote speakers, and updates on conference swag.
- PyPy v7.3.19 Release
- Poetry 2.0.0 Released
Show Links:
- How to Manage Python Projects With
pyproject.toml– Learn how to manage Python projects with the pyproject.toml configuration file. In this tutorial, you’ll explore key use cases of the pyproject.toml file, including configuring your build, installing your package locally, managing dependencies, and publishing your package to PyPI. - Build a To-Do App With Python and Kivy – “In this tutorial, you’ll go through a series of steps to build a basic To-Do app with Python, SQLite, and Kivy.”
- Mastering DuckDB When You’re Used to pandas or Polars – Why use DuckDB / SQL at all if you’re used to DataFrames? This article makes the case for some reasons why, and shows how to perform some operations which in DataFrames are basic but in SQL aren’t necessarily obvious.
- How to Work With Polars LazyFrames – In this tutorial, you’ll gain an understanding of the principles behind Polars LazyFrames. You’ll also learn why using LazyFrames is often the preferred option over more traditional DataFrames.
Discussion:
- Fiction/Non-Fiction Books on the Topic of CS?
- Christopher Trudeau’s most recommended books (picked by super fans)
- ctrudeau - LibraryThing
Project:
- preswald: Full-Stack Platform for Interactive Data Apps
- terminaltexteffects: Terminal Visual Effects Engine
Additional Links:
- Pi Day - Celebrate Mathematics on March 14th
- What’s new in Python 3.14 — Python 3.14.0a5 documentation
- Mark Litwintschik - Tech Blog
- Episode #224: Narwhals: Expanding DataFrame Compatibility Between Libraries
- Working With Python Polars - Video Course
- How to Deal With Missing Data in Polars – Tutorial
- Book Review: The Little Schemer - The Invent with Python Blog
Books Mentioned by Mr. Trudeau:
- “The Cuckoo’s Egg” by Clifford Stoll
- “Mythical Man Month” by Frederick Brooks
- “Phoenix Project” by Gene Kim
- “Dreaming in Code” by Scott Rosenberg
- “Digital Fortress” by Dan Brown
- “Godel Escher, Bach” by Douglas Hofstadlter
- “A Philosophy of Software Design” by John Ousterhout’s
- “I Hate The Internet” by Jarret Kobek
- “Snow Crash” by Neal Stephenson
- “Automate the Boring Stuff with Python” by Al Sweigart
- “Django In Action” by Christopher Trudeau
- “Refactoring Databases” by Scott W Ambler and Pramod J Sadalage
- “The C Programming Language” by Dennis M. Ritchie and Brian W. Kernighan
- “Open Source Licensing” by Lawrence Rosen
- “The Quick Python Book” by Naomi R. Ceder
- “Learn to Code By Solving Problems: A Python Programming Primer” by Daniel Zingaro
- “Python Automation Cookbook” by Jaime Buelta
Books Mentioned by Mr. Bailey:
- “The Little Schemer” by Daniel P. Friedman
- “Zen and the Art of Motorcycle Maintenance” by Robert M. Pirsig
- “Shop Class as Soulcraft: An Inquiry into the Value of Work” by Matthew B. Crawford
- “Django for Beginners, APIs, and Professionals” by William S. Vincent
- “Python Crash Course” by Eric Matthes
- “Automate the Boring Stuff With Python” by Al Sweigart
- “Fluent Python” by Luciano Ramalho
- “Practices of the Python Pro” by Dane Hillard
- “Daemon and Freedom™” by Daniel Suarez
Level up your Python skills with our expert-led courses: