Latent Space: The AI Engineer Podcast cover image

Latent Space: The AI Engineer Podcast

Emergency Pod: OpenAI's new Functions API, 75% Price Drop, 4x Context Length (w/ Alex Volkov, Simon Willison, Riley Goodside, Joshua Lochner, Stefania Druga, Eric Elliott, Mayo Oshin et al)

Jun 14, 2023

In this engaging discussion, AI expert Alex Volkov, prompt injection specialist Simon Willison, and software engineer Riley Goodside dissect OpenAI's transformative Functions API. They dive into the significant 75% price drop and the increase in context length, exploring the implications for developers. Eric Elliott shares prompting techniques to enhance accuracy, while the panel addresses security concerns related to prompt injection. The conversation is rich with insights on coding efficiency, the future of AI tools, and the evolution of user interactions with these technologies.

01:28:12

Creator website

Episode guests

Highlights

AI Chapters

Episode notes

The Shift Towards LLM Shell / Code Core World

Controlling Available Functions in Plugin Development

The Future of Prompt Injection

The Bullet Proof Way to Generate Structured Data

1.

Intro

2min

2.

OpenAI's Game-Changing Updates

9min

3.

Advancements in OpenAI's Functions API

17min

4.

Examining OpenAI's Drastic API Price Reductions and Strategic Motivations

2min

5.

Exploring OpenAI's Functions API

21min

6.

Navigating AI's New Functions API

16min

7.

Revolutionizing Data Handling with OpenAI's Functions API

6min

8.

Ethical Dilemmas in Security Vulnerabilities: The Challenge of Prompt Injection

3min

9.

Exploring the Steerability of the New 3.5 Model Updates

2min

10.

Exploring OpenAI's JSON Implementation

4min

11.

Innovating AI: A Hackathon and New Features

6min

Full Transcript and show notes: https://www.latent.space/p/function-agents?sd=pf

Timestamps:

[00:00:00] Intro

[00:01:47] Recapping June 2023 Updates

[00:06:24] Known Issues with Long Context

[00:08:00] New Functions API

[00:10:45] Riley Goodside

[00:12:28] Simon Willison

[00:14:30] Eric Elliott

[00:16:05] Functions API and Agents

[00:18:25] Functions API vs Google Vertex JSON

[00:21:32] From English back to Code

[00:26:14] Embedding Price Drop and Pinecone Perspective

[00:30:39] Xenova and Huggingface Perspective

[00:34:23] Function Selection

[00:39:58] Designing Code Agents with Function API

[00:42:16] Models as Routers

[00:46:48] Prompt Engineering replaced by Finetuning

[00:52:15] The 2 Code x LLM Paradigms

[00:56:30] Smol Models for the future

[00:58:54] The Evolution of the GPT API

[01:03:27] Functions API Security vs Prompt Injection

[01:16:18] GPT Model Upgrades

[01:17:36] JSONformer

[01:21:03] Closing Comments - What We Want Next

Get full access to Latent.Space at www.latent.space/subscribe

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.

App store banner

Play store banner