AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
2min chapter
Emergency Pod: OpenAI's new Functions API, 75% Price Drop, 4x Context Length (w/ Alex Volkov, Simon Willison, Riley Goodside, Joshua Lochner, Stefania Druga, Eric Elliott, Mayo Oshin et al)
Latent Space: The AI Engineer Podcast — Practitioners talking LLMs, CodeGen, Agents, Multimodality, AI UX, GPU Infra and all things Software 3.0
The New Role in Chat GPT
In the API, there's essentially a new role. So historically in chat to be team, there's a system prompt, the assistant and the user. And now we have a four for function and an extra field in the API for the function response or the list of functions that are capable available to it. The reason I guess I'm a little bit less excited about it is that we've had problem techniques to shape JSON responses and to select from this for a long time. They maybe fine tune a little bit towards choosing that well, but they still caution us that it might hallucinate things that don't exist.
00:00
Transcript
Episode notes
Get the Snipd
podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any
moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share
& Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode