

#447: Parallel Python Apps with Sub Interpreters
Feb 3, 2024
Eric Snow and Anthony Shaw discuss the exciting developments in Python, such as sub-interpreters, Faster CPython, async work, and the adoption of typing. They explore the concept of subinterpreters in Python processes, highlighting the benefits of isolation and enabling concurrency. The discussion also touches on consolidating global state, using sub interpreters as an API for concurrent futures, managing Python processes with sub interpreters, and implementing multi-phase init in extension modules to support sub-interpreters in Python.
Chapters
Transcript
Episode notes
1 2 3 4 5 6 7 8
Introduction
00:00 • 2min
The Release of Python 3.12 and the Inclusion of Per-Interpreter Gil
02:05 • 9min
Exploring Subinterpreters and Isolation in Python Processes
11:32 • 4min
Consolidating Global State and Sub-Interpreters
15:05 • 10min
Using Sub Interpreters as an API for Concurrent Futures and a Workshop on Managing Python Monorepo
25:25 • 3min
Interpreters, Data Exchange, and Sub-interpreters
27:59 • 19min
Managing Python processes and sub interpreters
47:06 • 21min
Implementing Multi-Phase Init in Extension Modules to Support Sub-Interpreters in Python
01:07:55 • 3min