Prompt engineering matters more than ever. But it’s evolving into something totally new:
A way for non-technical domain experts to solve complex problems with AI.
I spent an hour talking to prompt wizard Jared Zoneraich, cofounder and CEO of PromptLayer, about why the death of prompt engineering is greatly exaggerated. And why the future of prompting is equipping non-technical experts with the tools to manage, deploy, and evaluate prompts quickly.
We get into:
His theory around why the “irreducible” nature of problems will keep prompt engineering relevant
Prompt engineering best practices around prompts, evals, and datasets
Why it’s important to align your prompts with the language the model speaks
How to run evals when you don’t have ground truth
Why he believes that the companies who have domain experts to scope out the right problems will win in the age of gen AI
This is a must-watch for prompt engineers, people interested in building with AI systems, or anyone who wants to generate predictably good responses from LLMs.
If you found this episode interesting, please like, subscribe, comment, and share!
Want even more?
Sign up for Every to unlock our ultimate guide to prompting ChatGPT here: https://every.ck.page/ultimate-guide-to-prompting-chatgpt. It’s usually only for paying subscribers, but you can get it here for free.
To hear more from Dan Shipper:
Timestamps:
Introduction: 00:01:08
Jared’s hot AGI take: 00:09:54
An inside look at how PromptLayer works: 00:11:49
How AI startups can build defensibility by working with domain experts: 00:15:44
Everything Jared has learned about prompt engineering: 00:25:39
Best practices for evals: 00:29:46
Jared’s take on o-1: 00:32:42
How AI is enabling custom software just for you: 00:39:07
The gnarliest prompt Jared has ever run into: 00:42:02
Who the next generation of non-technical prompt engineers are: 00:46:39
Links to resources mentioned in the episode:
