AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
What's New in NLP Research?
OPT came out fairly early in this year. And I think it kind of surprised everyone, because looking back at last year, there weren't that many open source reproductions of large sizes. They documented a lot of their whole training process in a log work with sort of all kinds of insights about what trade no log. It was also surprising that reproducibility and open source seemed to be key aspect of OPT as well.