Coding Blocks Importance of Data Structures, Bad Documentation and Comments and More
11 snips
Apr 1, 2024 The hosts discuss the importance of data structures in software development. They mention a 8-bit looking keyboard that caught Joe's interest. They talk about frustrating code comments and poor documentation examples. They uncover the factors influencing data scientist salaries. They also share excitement for a new cloud computing podcast and discuss challenges with Google Cloud Platform services.
AI Snips
Chapters
Transcript
Episode notes
Audit Hot Paths For Better Structures
- Use maps (hash tables) when you need keyed lookup instead of scanning lists.
- Audit hot code paths in streaming jobs and swap inefficient structures before scaling hardware.
Pick Data Structures For Performance
- Choosing the right data structure dramatically affects streaming throughput and latency.
- Replacing a list with a map improved throughput by about 60x in a Flink pipeline.
Keep Stable IDs, Map Names In App
- Treat mutable display values as snapshots and keep a stable logical ID for lookup.
- If renames matter, map names at the application layer instead of rewriting every stored document.
