141 - Building an open source LM, with Iz Beltagy and Dirk Groeneveld
NLP Highlights
The ALMO Project: A General Purpose Model for AI2
The ALMO project doesn't have one central research question. It ties together several internal efforts that we're trying to grant a separate more detailed questions. There are some questions about architecture choices that might work like the Lion Optimizer. And there's at least two people at AI2 interested in measuring the energy usage of large language model training. Do you have anything to add? If so, please share it with us by emailing jennifer.smith@mailonline.co.uk.
00:00
Transcript
Play full episode
Remember Everything You Learn from Podcasts
Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
