Efficient Token-based Processing and Quality Management in Language Models

2min Snip

00:00

Play full episode

Summary

Transcript

Episode notes

Exploring the meticulous process of processing responses token by token in language models for improved efficiency and user experience, emphasizing accuracy and completeness. Discussion includes techniques for managing elements like URLs, bolding, and italics to enhance text quality.

Microsoft Copilot is a chatbot developed by Microsoft that launched in 2023 and is based on a large language model.

Justin Harris is a Principal Software Engineer at Microsoft and has an extensive background in classical machine learning and neural networks, including large language models. He joins the show to talk about Microsoft Copilot, natural language processing, ML team organization, and more.

Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer .