EP72 Joscha Bach on Minds, Machines & Magic
The Jim Rutt Show
00:00
GPT-3 Is a Three-Year Simple Text Processor That Can Produce a Coherent Universe
PT-3 seems to be an incremental extension over GPT-2, so basically uses magnitude more data. And the learning curves are not bending yet, so it seems that you can extend this even further. The quality of text that GPT-3 is producing in terms of coherence. So the illusion that this, what it writes corresponds to a self-coherent universe. This is much, much better than G PT-2. You are willing to entertain a completely fictional story about a completely fictional universe as long as it refers to a coherent universe. It's similar to understanding the role of people in society. But at a certain level of granularity, you don't have people
Play episode from 20:30
Transcript
