Beyang Liu and Steve Yegge from SourceGraph discuss code indexing, retrieval interfaces, and their SOTA 30% completion acceptance rate in Cody. They talk about the history of code search, RAG, fine tuning, data privacy, DSLs and LLMs, and the challenges and potential of AI coding agents.

Beyang Liu, CTO of Sourcegraph, discusses coding in collaboration with AI, reducing human toil, AI-generated code, and the future of software development in a world where AI can write high-quality code on its own.

This week on The Changelog we’re taking you to the hallway track of The Linux Foundation’s Open Source Summit North America 2023 in Vancouver, Canada. Today’s anthology episode features: Beyang Liu (Co-founder and CTO at Sourcegraph), Denny Lee (Developer Advocate at Databricks), and Stella Biderman (Executive Director and Head of Research at EleutherAI). Special thanks to our friends at GitHub for sponsoring us to attend this conference as part of Maintainer Month. Join the discussionChangelog++ members get a bonus 3 minutes at the end of this episode and zero ads. Join today!Sponsors:DevCycle – Build better software with DevCycle. Feature flags, without the tech debt. DevCycle is a Feature Flag Management platform designed to help you build maintainable code at scale. Sentry – See the untested code causing errors - or whether it’s partially or fully covered - directly in your stack trace, so you can avoid similar errors from happening in the future. Use the code CHANGELOG and get the team plan free for three months. Rocky Linux – Enterprise Linux, the open source community way. Featuring:Beyang Liu – Twitter, GitHubDenny Lee – Mastodon, Twitter, GitHub, LinkedInStella Biderman – Twitter, GitHub, LinkedIn, WebsiteAdam Stacoviak – Mastodon, Twitter, GitHub, LinkedIn, WebsiteJerod Santo – Mastodon, Twitter, GitHub, LinkedInShow Notes:The common denominator for these conversations is open source AI. Beyang Liu and his team at Sourcegraph are focused on enabling more developers to understand code and their approach to a completely open source, model agnostic, coding assistant called Cody has significant interest from us. Denny Lee and the team at Databricks recently released Dolly 2.0, the first open source, instruction-following LLM, that has been fine-tuned on a human-generated instruction dataset and is licensed for research and commercial use. They want to be the platform of choice the future of AI development. Stella Biderman gave the keynote address on generative AI at the conference and works at the base layer doing open source research, model training, and AI ethics. Stella trained the EleutherAI pythia model family that Databricks’ used to create Dolly - 2.0. Cody from Sourcegraph - Read, write, and understand code 10x faster with AI. Cody answers code questions and writes code for you by reading your entire codebase and the code graph. Free Dolly: Introducing the World’s First Truly Open Instruction-Tuned LLM EleutherAI - Empowering Open Source Artificial Intelligence Research Something missing or broken? PRs welcome!

CTO and Co-Founder of Sourcegraph, Beyang Liu, discusses AI coding, making RAG better, and building towards an agentic future. They cover AI products in Sourcegraph, the current state of AI coding, customizing RAG, and the future of engineers. Liu shares insights on inference cost, evaluating products, and surprises in their journey.

Beyang Liu, developer of Cody, an open-source AI coding assistant, discusses the challenges and process of incorporating AI into existing products, navigating complex code bases, and the technology used in building Cody. The chapter also touches on the complexity of fine-tuning AI models and supporting multiple language models in Cody.