
Automating code optimization with LLMs
Practical AI
Building your own chatbot for code optimization
We have a lot of experience with LLMs and have had success with a big technology firm. However, they initially had concerns about IP and proprietary code. We offered them a custom on-premise solution where they could use open source LLMs on their data without sharing it. They could generate their own training data set and fine-tune their own model. This approach is essential for industries like finance, technology, and defense that want to protect their code. LLMs also have powerful similarity search capabilities, allowing organizations to optimize and build chatbots on their code. We even identified instances where different teams had implemented the same functionality in a slightly different way. This saves time and takes advantage of the underlying LLM technology. For example, Databricks acquired Mosaic ML to help organizations fine-tune their LLMs on their own data. We have adopted this product for code optimization and continue to build impressive things using LLMs.