High Signal: Data Science | Career | AI

Barr Moses, co-founder and CEO of Monte Carlo, shares insights on the AI readiness crisis many companies face. She reveals high-stakes data disasters, including a shocking $100M schema change. The discussion emphasizes the necessity of data quality and observability, as organizations struggle to align their ambitions with reality. Barr also highlights the transformative role of LLM agents in improving data debugging. Overall, it's a sharp critique of the disconnect between current data practices and the demands of AI.

Tim O’Reilly, founder of O'Reilly Media and a tech thought leader, discusses the dawn of a new era in programming. He argues that AI is enhancing, not eliminating, programming roles, making the field more accessible. The conversation dives into the history of computing revolutions, the impact of venture capital on ride-hailing innovations, and the critical role of community in a decentralized tech future. O’Reilly emphasizes education's shift toward AI skills and advocates for collaboration and ethical practices as we navigate this transformative landscape.

Stefan Wager, a Stanford professor and expert in causal machine learning, dives into the misalignments between prediction and decision-making. He argues that traditional machine learning often neglects the crucial 'what-if' questions businesses face. Stefan shares insights on causal relationships and emphasizes the need for robust experimentation to make informed decisions. He explores the role of causal ML in enhancing customer engagement and optimizing revenue, while also discussing common pitfalls in experimental design, making a compelling case for collaborative learning in the data science field.

Peter Wang, Chief AI Officer at Anaconda and a pivotal force in the open-source data science community, dives into the transformative role of AI in software development. He questions whether engineers will transition from coding to orchestrating intelligence as AI becomes more prevalent. Peter discusses the challenges within the open-source realm and emphasizes the importance of collaboration and adaptability in navigating AI's evolution. He also highlights the need for effective communication between tech builders and business leaders to drive innovation in this new landscape.

Ari Kaplan, Global Head of Evangelism at Databricks and a pioneer in sports analytics, dives into the crucial balance between harnessing data intelligence and the hype surrounding AI. He shares insights from his experiences with Major League Baseball and McLaren’s Formula 1, highlighting how effective data usage transformed sports strategies. Kaplan emphasizes the need to leverage quality data for better decision-making instead of relying solely on AI, and discusses the evolving landscape of data science skills necessary for future leaders.

Eric Colson, former Chief Algorithms Officer at Stitch Fix and VP of Data Science at Netflix, discusses why 90% of data science initiatives fail. He emphasizes the need to treat data scientists as strategic drivers rather than mere service providers. Colson highlights the power of cognitive repertoires in problem-solving and advocates for a culture of experimentation, where trial and error leads to innovation. He also shares insights on restructuring data teams to transform them from cost centers into revenue generators, enhancing business value through collaboration.

Elena Grewal, former Head of Data Science at Airbnb, political consultant, professor at Yale, and an ice cream shop owner, discusses her impressive career in building data teams. She shares how she scaled Airbnb’s data function and why trust is essential for effective teamwork. Elena explains applying data science in diverse fields, including politics and running an ice cream business. She emphasizes the importance of experimentation in decision-making and critical thinking for future leaders, illustrating that data principles are universal, from tech to ice cream.

Chris Wiggins, Chief Data Scientist at The New York Times and a Columbia University professor, discusses the transition from predictive to prescriptive analytics. He emphasizes the importance of actionable decision systems, highlighting how hospitals could benefit from prescription-based treatments. Wiggins introduces the AI Hierarchy of Needs, outlines strategies for scaling data teams, and underlines the necessity of empathy in data science for effective collaboration. His insights help bridge the gap between advanced technology and practical organizational applications.

Hilary Mason, a renowned data scientist and co-founder of Hidden Door, dives into the transformative landscape of data science amid the rise of AI. She emphasizes the crucial role of human judgment in guiding AI outputs and warns against over-reliance on prompts, advocating for rich contextual approaches. Highlighting her company's mission, Hilary discusses turning AI's challenges into creative storytelling opportunities. She also offers insights on navigating career paths in the evolving job market, stressing the need for empathy and critical skills in a world shaped by automation.

Gabriel Weintraub, the Amman Professor of Operations at Stanford, shares his wealth of experience from Uber and Mercado Libre. He discusses bridging the gap between leadership and tech teams to foster data-driven organizations. Gabriel emphasizes the importance of starting with foundational steps in AI adoption and creating a culture that celebrates experimentation. He also highlights the unique AI opportunities in Latin America and the transformative power of generative AI for smaller teams, advocating a problem-first approach to drive impact.