
[44] Hady Elsahar - NLG from Structured Knowledge Bases (& Controlling LMs)
The Thesis Review
The Evolution of the Sector-Sector Model
Back then the sector-sec models were not so good in doing like named entities that are rare how to represent them. Back then I mean 2015 or 2014 they had this copy mechanisms which is based on the attention. Things evolved after some while from 2018 onwards the scopy mechanisms are not so like I mean transformer can do this but so there's no need for that anymore.
00:00
Transcript
Play full episode
Remember Everything You Learn from Podcasts
Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.