4min chapter

The Changelog: Software Development, Open Source cover image

LLMs break the internet (Interview)

The Changelog: Software Development, Open Source

CHAPTER

How to Train a Language Model on Your Own Documentation

Open source projects providing little LLMs alongside their docs or with their docs that are trained on their docs. Astro is one of these where they'll have a little train language model deal where you can chat with it about and just knows everything about the Astro docs. embeddings search which is a way of doing semantic searches so you can take the user's question and plotted in 1500 dimensional space against the previously plotted documents then find the stuff that's semantically closest to it but even if none of the keywords match it should still catch the documentation talking about the sort of higher level concept than talking about.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode