
#017: Ken Miller – Podcasting, AI, ChatGPT, Leadership, Learning, and Fathom
The Prompt
00:00
The Next Iteration of Large Language Models
I think that what we're going to see over the course of the next two years is not so much an expansion and the number of parameters or like the size of the model, but a fundamental improvement to the training data used to train the model. I really think that the next iteration of large language models really needs to overcome this stuck in time problem. Everybody will be using one version of a generative large language model while the other one's training then they'll just swap places.
Transcript
Play full episode