How to Make Chatbots Smaller

4min Snip

00:00

Play full episode

Summary

Transcript

Episode notes

GPT 3 is too big to be practical. 175 billion parameters can't fit in the memory of a single GPU. We want it eventually to have models that can fit in a phone and still do useful things. Yuval Harari: I don't know how much more, at least for this very particular problem of producing text, I don't knows how much more richer or larger we could give it.

Are new AI technologies like ChatGPT about to massively disrupt our world? Drawing from his recent New Yorker article on the topic, Cal explains exactly how programs like ChatGPT work, and uses this knowledge to explain why we can calm our fears about this new technology.

Below are the questions covered in today's episode (with their timestamps). Get your questions answered by Cal! Here’s the link: https://bit.ly/3U3sTvo

Video from today’s episode: youtube.com/calnewportmedia

Today’s Deep Question: How does ChatGPT work? (And should we worry about it?) [11:24]

- Is there anything AI won’t do better than humans? [57:30]

- How will AI end up disrupting knowledge work? [1:02:27]

- Should I quit web development before AI eliminates the industry? [1:07:32]

- Will AI create mass job loss in the next five years? [1:11:52]

SOMETHING INTERESTING:

- NPR leaves Twitter [1:21:11]

npr.org/2023/04/12/1169269161/npr-leaves-twitter-government-funded-media-label

Links:

newyorker.com/science/annals-of-artificial-intelligence/what-kind-of-mind-does-chatgpt-have

twitter.com/tqbf/status/1598513757805858820