AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
The Importance of Language Models in Generative Data Augmentation
GPD: I love this idea where you use the large language model to generate a potential query for a document and then supervise the training of the embedding models. And so that kind of like, it solves the data problem of, you know, the language model can write queries potentially. It's like your data engine needs a cold start. GPD: The long tail of requests ends up being nearly as important as the bulk in creating high quality products.