139 - Coherent Long Story Generation, with Kevin Yang
NLP Highlights
How to Write a Story That's Consistent With Your Premises
The rewriting module is designed to evaluate whether a given continuation like every 256 tokens or whatever. It's trying to detect both whether it is actually coherent with the previous part of the story and also whether it actually is relevant to what the plan says we're supposed to do next in the story. We additionally tried to do some re-ranking after the fact where we'll like at every step we'll generate a few different possible story situations and try to determine which one is the best. And because this you can think of it a little bit as when humans write stories like like I might write a passage and be like okay this passage actually sucks. So maybe let me like write something else.
Remember Everything You Learn from Podcasts
