The Changelog: Software Development, Open Source

ANTHOLOGY — Open source AI (Interview)

May 24, 2023

Beyang Liu, Co-founder of Sourcegraph, Denny Lee, Developer Advocate at Databricks, and Stella Biderman, Executive Director at EleutherAI, dive into the world of open-source AI. They discuss the evolution of coding tools and the transformative potential of large language models in development. The panel also highlights ethical considerations and user data privacy related to AI. With insights on the accessibility of coding through innovative solutions, the conversation is both enlightening and engaging, peppered with humor about the quirks of tech procrastination.

01:38:06

Creator website

Episode guests

Stella Biderman

Denny Lee

Beyang Liu

AI Chapters

Episode notes

Intro

2min

Ensuring Reliability in Feature Flag Platforms

2min

The Evolution of Code Understanding Tools

2min

The Evolution of Coding and AI Integration

17min

Empowering Data Privacy Through Zero Attention Policies

4min

Empowering Development with AI and Open Source

19min

Enhancing Development with CodeCov and Sentry

5min

Procrastination and AI Innovations

18min

Enhancing Podcast Content with AI Transcripts

4min

10.

CentOS Transition and the Rise of Rocky Linux

3min

11.

Navigating Open-Source AI Models: Pythia and Beyond

18min

12.

Community Engagement and Research in AI Through Discord

4min

This week on The Changelog we’re taking you to the hallway track of The Linux Foundation’s Open Source Summit North America 2023 in Vancouver, Canada. Today’s anthology episode features: Beyang Liu (Co-founder and CTO at Sourcegraph), Denny Lee (Developer Advocate at Databricks), and Stella Biderman (Executive Director and Head of Research at EleutherAI).

Special thanks to our friends at GitHub for sponsoring us to attend this conference as part of Maintainer Month.

Join the discussion

Changelog++ members get a bonus 3 minutes at the end of this episode and zero ads. Join today!

Sponsors:

DevCycle – Build better software with DevCycle. Feature flags, without the tech debt. DevCycle is a Feature Flag Management platform designed to help you build maintainable code at scale.
Sentry – See the untested code causing errors - or whether it’s partially or fully covered - directly in your stack trace, so you can avoid similar errors from happening in the future. Use the code CHANGELOG and get the team plan free for three months.
Rocky Linux – Enterprise Linux, the open source community way.

Featuring:

Beyang Liu – GitHub, X
Denny Lee – GitHub, LinkedIn, Mastodon, X
Stella Biderman – Website, GitHub, LinkedIn, X
Adam Stacoviak – Website, GitHub, LinkedIn, Mastodon, X
Jerod Santo – GitHub, LinkedIn, Mastodon, X

Show Notes:

The common denominator for these conversations is open source AI.

Beyang Liu and his team at Sourcegraph are focused on enabling more developers to understand code and their approach to a completely open source, model agnostic, coding assistant called Cody has significant interest from us.

Denny Lee and the team at Databricks recently released Dolly 2.0, the first open source, instruction-following LLM, that has been fine-tuned on a human-generated instruction dataset and is licensed for research and commercial use. They want to be the platform of choice the future of AI development.

Stella Biderman gave the keynote address on generative AI at the conference and works at the base layer doing open source research, model training, and AI ethics. Stella trained the EleutherAI pythia model family that Databricks’ used to create Dolly - 2.0.

Cody from Sourcegraph - Read, write, and understand code 10x faster with AI. Cody answers code questions and writes code for you by reading your entire codebase and the code graph.
Free Dolly: Introducing the World’s First Truly Open Instruction-Tuned LLM
EleutherAI - Empowering Open Source Artificial Intelligence Research

Something missing or broken? PRs welcome!