AI Snips
Chapters
Transcript
Episode notes
Challenges of Long-Form Story Generation
- Large language models (LLMs) like GPT-3 can generate fluent text at the paragraph level.
- However, they struggle with long-range coherence in stories exceeding 2,000 words, often losing the plot.
Shifting Focus on Coherence
- Prior work on story coherence has focused on shorter texts (sentences or paragraphs) due to limitations of older models.
- With LLMs, the challenge shifts to maintaining coherence over thousands of words, necessitating different approaches.
Novel Approach to Long Story Generation
- Kevin Yang's team is the first to attempt generating stories of this length using LLMs.
- Previous research did not generate stories on this scale.