Talk Python To Me cover image

#417: Test-Driven Prompt Engineering for LLMs with Promptimize

Talk Python To Me

The Differences Between Test Driven Development and Unit Testing

4min Snip

00:00
Play full episode
prompt amized is a toolkit to help people write to evaluate and score and understand while they iterate on their while doing prompt engineering. We have a big corpus that luckily was contributed by I forgot which university but a bunch of PhD people did a text-to-sequel contest at Yale. So for us we're able to take that test set and some of our own test sets and run it at scale against you know open AI or against llama or against different models with 73 percent accuracy. It's non binary so it's also you don't need perfection to ship you just need better than the previous version or good enough to start it with.

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode