The Sentience Institute Podcast cover image

Raphaël Millière on large language models

The Sentience Institute Podcast

00:00

The Problem With Memorization in GP4

There are many, many websites where people will discuss examples of questions from various exams. That's a problem if you want to claim that your system has achieved excellent performance on an exam. It could be that the system has memorized the right answers to certain questions and this is also very good at memorization. So I'm putting some precautions in a technical report to GP4 but it's debatable how well they were able to control for that.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app