The Internal Working of LLMs

A lot of the word that goes in LLMs today, first of all, is way more engineering than people expect. We recently released our own BSPOC model that we trained from the ground up. And also a very important part for us is, you know, we have a lot of users. So how to deploy it, how to have optimizing inference, how to lower the latency.