Software Unscripted Making Parsing I/O Bound with Daniel Lemire
Aug 17, 2023
Daniel Lemire, creator of simdjson, the fastest JSON parser, discusses parsing performance, benchmarking, and real-world experimentation. They explore multi-threading benefits in parsing, eliminating parsing steps with Captain Proto, iterative development, AVX2 and AVX512 performance impact, handling comments and strings, different parsing approaches, and surprising results with hash maps and index maps in the Rust compiler.
Chapters
Transcript
Episode notes
1 2 3 4 5 6 7 8
Introduction
00:00 • 6min
Exploring the Benefits of Multi-Threading in Parsing
05:39 • 7min
Eliminating Parsing Step and the Consequences of Memory Corruption
12:41 • 2min
Improving the Parser through Iterative Development
14:58 • 3min
AVX2, AVX512, and Performance Impact
17:29 • 13min
Parsing Grammars and Handling Comments and Strings
30:23 • 15min
Different Approaches to Parsing
45:14 • 20min
Surprising Results with Hash Maps and Index Maps
01:05:31 • 12min