Practical AI cover image

Automating code optimization with LLMs

Practical AI

NOTE

Building your own chatbot for code optimization

We have a lot of experience with LLMs and have had success with a big technology firm. However, they initially had concerns about IP and proprietary code. We offered them a custom on-premise solution where they could use open source LLMs on their data without sharing it. They could generate their own training data set and fine-tune their own model. This approach is essential for industries like finance, technology, and defense that want to protect their code. LLMs also have powerful similarity search capabilities, allowing organizations to optimize and build chatbots on their code. We even identified instances where different teams had implemented the same functionality in a slightly different way. This saves time and takes advantage of the underlying LLM technology. For example, Databricks acquired Mosaic ML to help organizations fine-tune their LLMs on their own data. We have adopted this product for code optimization and continue to build impressive things using LLMs.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner