Building Apache SAMHSA: Motivation, Design Philosophy, and Lessons Learned

The chapter explores the creation of Apache SAMHSA, LinkedIn's streaming system infrastructure on Apache Kafka, detailing the rationale behind using Kafka for messaging in stream processing. It discusses the architecture's simplicity, the importance of building SAMHSA as a library for wider adoption, and the experiences and challenges of evangelizing open-source projects. Additionally, the chapter delves into career transitions, emphasizing the value of considering impact, learning opportunities, and company culture when choosing a new job.