2min chapter

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch cover image

20VC: Why No Models Today Will Be Used in a Year, Why Open Will Always Beat Closed in AI, Why Proprietary Data is Less Important Than Ever And Why EU AI Regulation is a Disaster with Alex Lebrun, Founder & CEO @ Nabla

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

CHAPTER

How to Fine-Tune a Large-Long-Range Model

A large-long-range model is trained in two phases. First phase is unsupervised pre-training, where it's fed with huge amount of text. The second phase is fine-tuning - giving more precise instruction how it should behave. With only 1,000 question and answer examples, you can get something that performs better than GPT-3 or almost at the level of GPT-4.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode