Episode 110: Wisdom in Building Data Infrastructure, Lessons From Open-Source Development, The Missing README, and The Future of Data Engineering with Chris Riccomini

Chris Riccomini, a data engineer with experience at PayPal and LinkedIn, discusses building data infrastructure, lessons from open-source development, and the future of data engineering. Topics include scaling Hadoop clusters, choosing big data solutions, strategies for early-stage startups, and the importance of running models and microservices on the same continuous delivery stack. Chris also talks about creating Apache Samza, evangelizing open-source projects, and the evolution of data infrastructure at WePay. The podcast explores mastering interviewing skills in data engineering hiring, building Apache SAMHSA, the evolution of Apache Airflow, designing principles of Apache Kafka, and the future of data engineering predictions and industry insights.