AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
What Are Your Thoughts on GPT-3 and Language Models?
In the 90s, I was in New Zealand and I had an amazing professor, Ian Vitten, who realized I was bored in class and put me in his lab. He gave me the task to just cover grammatical structure in an unknown language. And he gave me the largest computer at the whole university,. It had two gigabytes of RAM, which was amazing. And I wrote everything in C with some in-memory compression to do statistics over the language. The effect that it can have on your mental wiring can be very dangerous, I think. Let's talk about AI a little bit. What are your thoughts about GPT-3 and language models trained with self-supervised