

#442: Ultra High Speed Message Parsing with msgspec
Dec 14, 2023
Jim Crist-Harif, data exchange framework creator, discusses his super fast data modeling and validation framework called msgspec. They compare it to Python's native classes and APIs like Pydantic and Pidantic. They explore the benefits of using classes for validation in message parsing and discuss challenges in working on hobby projects. The chapter also dives into optimizing message parsing for performance and extending msgspec with new types.
Chapters
Transcript
Episode notes
1 2 3 4 5 6 7 8 9
Introduction
00:00 • 3min
Introduction and Discussion on IBIS and Dask
02:40 • 1min
Exploring Python Dantic and Pidantic
04:09 • 18min
Advantages of Using Classes for Validation in Message Parsing
21:57 • 5min
Challenges of a Hobby Project and Choosing the Right Programming Language
27:03 • 3min
Data Classes and Message Spec Structs
29:36 • 7min
Optimizing Message Parsing for Performance
36:49 • 17min
Extending and Adding New Types in Msgspec
54:18 • 4min
Discussing Availability and Encouraging Usage of a Hobby Project
57:49 • 2min