141 - Building an open source LM, with Iz Beltagy and Dirk Groeneveld
NLP Highlights
00:00
How to Build a Language Model and Use It in an Application or Adown Machine Test
There are two broad research questions here. How do you build a language model and how you use it in an application or an adown machine test? And both of them have lots of open questions. If we are only able to use language models behind an API that we can only explore one question, which is how to use an existing language model. We'll be very limited in the kind of ways and manipulations you can do to adapt the language model for a specific test. So with an open source language model, you can explore so many different ways you can adapt thelanguage model to your test or to your application.
Transcript
Play full episode
