AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
5min chapter
20VC: Why Data Size Matters More Than Model Size, Why The Google Employee Was Wrong; OpenAI and Google Have the Advantage & Why Open Source is Not Going to Win with Douwe Kiela, Co-Founder @ Contextual AI
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
The Future of Language Models
I don't think that the actual foundation model builders like OpenAI and contextual are going to build that technology in-house. It's probably going to be an external audit. How much of a concern is data contamination at this stage, do you think? If you're sitting in OpenAI today, how do you think they discuss data contamination? I think they're starting to invest more in evaluation. They have an army of annotators now, human annotators who are checking their models. But obviously they're not going to share that with the world. So there is just a non-zero, but very, very, very chance. There will be some sort of paperclip maximizer scenario
00:00
Transcript
Episode notes
Get the Snipd
podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any
moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share
& Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode