MLOps.community  cover image

Product Engineering for LLMs // LLMs in Production Conference Part III // Panel 2

MLOps.community

NOTE

Exploring Frontiers in Language Models and Synchronous Auto Complete

Co-pilot is an interesting and ambitious project being worked on by Alex Gravely. The challenge is to have low latency in order to stay ahead of user typing speed. The goal is to have almost synchronous auto complete with local contacts. However, there is a need to explore asynchronous approaches in software engineering to allow engineers to run a job and come back with results or questions.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner