Terry Sejnowski, Francis Crick Chair at The Salk Institute, dives into the complexities of large language models like ChatGPT. He questions whether these models truly understand language or just mimic human intelligence. Discussion ranges from the evolution of AI and the pursuit of artificial general intelligence (AGI) to the intriguing intersection of neurobiology and AI. Sejnowski also addresses ethical considerations surrounding AI consciousness and its implications for the future, challenging us to rethink what it means to be intelligent.
01:21:03
forum Ask episode
web_stories AI Snips
view_agenda Chapters
menu_book Books
auto_awesome Transcript
info_circle Episode notes
insights INSIGHT
LLMs' Unexpected Generality
Large language models shocked engineers because they handle many tasks generally, unlike prior AI which solved specific problems.
This generalizes AI capabilities beyond expectations, changing human-computer interaction fundamentally.
insights INSIGHT
LLM Learning Via Next-Word Prediction
Large language models learn by predicting the next word using self-supervised learning, requiring no labeled data.
This prediction task forces them to embed semantic meaning into rich vector representations, enabling broad understanding.
insights INSIGHT
Key Concepts Behind GPT Models
'Generative' refers to producing word sequences; 'pre-trained' means trained extensively before use; 'transformer' architecture enables context memory and self-attention in LLMs.
These elements together empower LLMs to generate relevant and context-aware language swiftly.
Get the Snipd Podcast app to discover more snips from this episode
In 'ChatGPT and the Future of AI', Terrence Sejnowski offers a nuanced exploration of large language models (LLMs) like ChatGPT. The book delves into the debates surrounding LLMs’ comprehension of language, the notions of 'thinking' and 'intelligence', and the historical evolution of language models. It focuses on the role of transformers, the correlation between computing power and model size, and the intricate mathematics shaping LLMs. Sejnowski also discusses the potential future of AI, including next-generation LLMs inspired by nature and the importance of developing energy-efficient technologies. The book is structured into three parts: Living with Large Language Models, Transformers, and Back to the Future, making it accessible and valuable for both tech-savvy readers and newcomers to the field.
The Computational Brain
Patricia Churchland
Terrence J. Sejnowski
This book addresses the foundational ideas of the emerging field of computational neuroscience. It examines a diverse range of neural network models and considers future directions of the field. The authors focus on how groups of neurons interact to enable perception, decision-making, and movement, and how computer models constrained by neurobiological data can reveal these processes. The book covers topics such as visual perception, learning and memory, and sensorimotor integration, and is written for both experts and novices in neuroscience, computer science, cognitive science, and philosophy.
Contribute what you can to help Closer To Truth continue exploring the world's deepest questions without the need for paywalls.
Terry Sejnowski offers a nuanced exploration of large language models (LLMs) like ChatGPT and what their future holds. How should we go about understanding LLMs? Do these language models truly understand what they are saying? Or is it possible that what appears to be intelligence in LLMs may be a mirror that merely reflects the intelligence of the interviewer? In this discussion of his book ChatGPT and the Future of AI, Sejnowski, a pioneer in computational approaches to understanding brain function, answers all our urgent questions about this astonishing new technology.
Terrence J. Sejnowski is Francis Crick Chair at The Salk Institute for Biological Studies and Distinguished Professor at the University of California at San Diego. He has published over 500 scientific papers and 12 books, including The Computational Brain with Patricia Churchland. He was instrumental in shaping the BRAIN Initiative that was announced by the White House in 2013, and he received the prestigious Gruber Prize in Neuroscience in 2022.
Closer To Truth 
