3min chapter

Deep Papers cover image

Toolformer: Training LLMs To Use Tools

Deep Papers

CHAPTER

How Does a Language Model Use Different APIs?

In the current version of the tool form, we have like one limitation that we impose upon those APIs and that is they need to be text to text. And basically how those models can then call tools is they would first generate text as long as they want. And we allow them to generate one special token, one special kind of word that would signalize, now I want to call an API. We stop it from producing any further tokens. We do that API call. So we call our calculator or we look something up in our calendar, we do a search. We get the result from that, which is also a piece of text. And after that, we let it continue writing text

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode