Google Cloud Platform Podcast Derwen, Inc. with Paco Nathan
This week, Jon Foust and Michelle Casbon bring you another fascinating interview from our time at Next! Michelle and special guest Amanda were able to catch up with Paco Nathan of Derwen AI to talk about his experience at Next and learn what Derwen is doing to advance AI.
Paco and Derwen have been working extensively on ways developer relations can be enhanced by machine learning. Along with O’Reilly Media, Derwen just completed three surveys, called ABC (AI, Big Data, and Cloud), to look at the adoption of AI and the cloud around the world. The particular interest in these studies is a comparison between countries who have been using AI, Big Data, and Cloud for years and countries who are just beginning to get involved. One of the most interesting things they learned is how much budget companies are allocating to machine learning projects. They also noticed that more and more large enterprises are moving, at least partially, to the cloud.
One of the challenges Paco noticed was the difference between machine learning projects in testing versus how they act once they go live. Here, developers come across bias, ethical, and safety issues. Good data governance polices can help minimize these problems. Developing good data governance policies is complex, especially with security issues, but it’s an important conversation to have. In the process of computing the survey data, Paco discovered many big companies spend a lot of time with this issue and even employ checklists of requirements before projects can be made live.
In his research, Paco also discovered that about 54% of companies are non-starters. Usually, their problems stem from tech debt and issues with company personnel who do not recognize the need for machine learning. The companies working toward integrating machine learning tend to have issues finding good staff. Berkeley is working to solve this problem by requiring data science classes of all students. But as Paco says, data science is a team sport that works well with a team of people from different disciplines. Paco is an advocate of mentoring, to help the next generation of data scientists learn and grow, and of unbundling corporate decision making to help advance AI.
Amanda, Michelle, and Paco wrap up their discussion with a look toward how to change ML biases. People tend to blame ML for bias outcomes, but models are subject to data we feed in. Humans have to make decisions to work around that by looking at things from a different perspective and taking steps to avoid as much bias as we can. ML and humans can work together to find these biases and help remove them.
Paco NathanPaco Nathan is the Managing Parter at Derwen. He has 35+ years tech industry experience, ranging from Bell Labs to early-stage start-ups. Paco is also the Co-chair Rev. Advisor for Amplify Partners, Recognai, Primer AI, and Data Spartan. He was formerly the Director of Community Evangelism for Databricks and Apache Spark.
Cool things of the week- CERN recreated the Higgs discovery on GCP video
- To discover the Higgs yourself, check out the CERN open data portal site
- Fun facts from Michelle’s visit:
- Derwen, Inc. site
- Derwen, Inc. Blog blog
- Cloud Programming Simplified: A Berkeley View on Serverless Computing paper
- Apache Spark site
- Google Cloud Storage site
- Datastore site
- Kubeflow site
- Quicksilver site
- O’Reilly Media site
- Google Knowledge Graph site
- Jupyter site
- JupyterCon site
- The Economics of Artificial Intelligence site
- “Why Do Businesses Fail At Machine Learning?” by Cassie Kozyrkov video
- The Gutenberg Galaxy site
- Programmed Inequality site
Jon is in New York for Games for Change.
Michelle and Mark Mirchandani are back in San Francisco.
Brian & Aja are at home in Seattle.
Gabi is in Brazil.
Sound Effect Attribution- “Crowd laugh.wav” by tom_woysky of Freesound.org