The Thesis Review cover image

[46] Yulia Tsvetkov - Linguistic Knowledge in Data-Driven NLP

The Thesis Review

CHAPTER

Paradigm Shifts in the Way We Build Models Today

In terms of technical modeling, I would like to see some paradigm shifts in the way we build models today. One example would be getting rid of sub-worlds, units that are not informed by what a world is or what a unit of meaning is and not transferable across languages. In terms of ethics,  I don't know if it makes sense to build a big language model without ethical considerations, and then have ethical track papers that criticize and fix that model. This should not be disjoint research areas, right? It should be one of the considerations,. Like we preprocess our data in certain ways, and there should be considerations, what kind of problems we want to

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner