Nate Sesti, Continue.dev co-founder, discusses their open source alternative to GitHub Copilot, allowing code assistance within IDEs like VSCode. They cover running multiple AI models simultaneously, optimal hardware for their tool, and its benefits over existing solutions. Nate shares insights on starting with Continue and its advantages for developers.
Continue.dev provides open-source AI models for local code completion and chatbots in popular IDEs like VS Code and JetBrains.
Users can choose between internet and local AI models with Continue.dev, ensuring data privacy and customization options for enhanced coding productivity.
Deep dives
AI Open Source Tool for Code Assistance
Continue.dev offers an open-source solution for running local AI language models (LLMs) for code completion and chat bots in various IDEs, such as VS Code and JetBrains. Their tool allows users to choose from multiple models, offering an alternative to existing tools like GitHub Copilot. The aim is to provide a highly configurable and locally deployable option for developers.
Background and Evolution of Continue
Continue was inspired by a deep respect for GitHub Copilot, leading to experimentation with large language models and the creation of an open-source solution. The founder's background includes engineering roles at a startup and NASA JPL. The tool aims to empower developers to experiment with different LLMs to enhance their productivity.
Local Mode Flexibility and Security
Continue's emphasis on 'local mode' enables developers to work without internet dependencies, offering full control over data privacy and security. Users can select between local or cloud models based on their needs, ensuring compatibility with security policies and personal preferences.
Customization and Future Enhancements
Continue's focus on customization allows users to tailor prompts for specific coding tasks, improving code quality and productivity. The tool's depth of customizability differentiates it, hinting at a trend where developers may spend time crafting tools that enhance their coding experience. Future updates may include enhanced model capabilities and increased user control over AI interactions.
Bret and Nirmal are joined by Continue.dev co-founder, Nate Sesti, to walk through an open source replacement for GitHub Copilot. Continue lets you use a set of open source and closed source LLMs in JetBrains and VSCode IDEs for adding AI to your coding workflow without leaving the editor.
You've probably heard about GitHub Copilot and other AI code assistants. The Continue team has created a completely open source solution as an alternative, or maybe a superset of these existing tools, because along with it being open source, it's also very configurable and allows you to choose multiple models to help you with code completion and chatbots in VSCode, JetBrains, and more are coming soon.
So this show builds on our recent Ollama show. Continue uses Ollama in the background to run a local LLM for you, if that's what you want to Continue to do for you, rather than internet LLM models.