3min chapter

The Thesis Review cover image

[22] Graham Neubig - Unsupervised Learning of Lexical Information

The Thesis Review

CHAPTER

The Future of Syntax Based Models

In your thesis, the models were these phrase based models. And I think the reason why is because they fundamentally didn't have the ability to handle kind of the hierarchical syntactic structure of language. Now syntax based models did have this ability but the problem is analyzing syntax is hard,. Even defining what you mean by syntax is hard. But then neural MT came out and I would have never believed a priori that neural MT would actually be able to handle syntax properly and generalize things like this. It was a very interesting transition to see the whole field completely turned on its head.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode