4min chapter

The Thesis Review cover image

[44] Hady Elsahar - NLG from Structured Knowledge Bases (& Controlling LMs)

The Thesis Review

CHAPTER

How to Sample From Unnormalized Scorers

You could actually if you apply MCMC like MCMC on any score so what's that unnormalized distribution that satisfies your constraints is the score. Many people who work on EBM's will not call that an EBM but because it doesn't have a neural model inside but it don't have to learn an EBM you could also define an EBM. So then you've looked into both these I guess like in the original you would actually do this fine tuning procedure to match this distribution and then you said that recently you've been looking into just directly sampling from it.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode