141 - Building an open source LM, with Iz Beltagy and Dirk Groeneveld
NLP Highlights
The Impact of AMD on AI2
The project essentially started bottom up and we realized that there were people who are already working more on answering some of these research questions. The big ones are of course AMD and CSE who made the CSE has made the Lumik cluster available to us for this project without which we couldn't be thinking about the scale that we're training at right now. I've mentioned Lusac and Mal a couple of times, they have shared a lot of data with us and we started with their code base. Serge is one of them for getting instruction tuning data. If I try to name all the projects, I'll forget one so I will not try. But I guess the U-series is
00:00
Transcript
Play full episode
Remember Everything You Learn from Podcasts
Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
