Anders Sandberg on ChatGPT and the Future of AI
Future of Life Institute Podcast
00:00
How to Make a Multi-Modal Language Model?
The real issue is not so much what you want to add, but just how much can you add and do you have enough compute for it? So, making a multi-modal language model seems totally obvious. But the problem here is more like, okay, can you get enough training data? I think we're approaching a kind of weird oil crisis. Having a really good curated repository of good training data is not trivial to get your hands on.
Transcript
Play full episode
