
All Things Machine Learning - ML 115
Adventures in Machine Learning
00:00
The Importance of Huggingface
Chat GPT 3 was trained on 13 billion unique tokens. Chat GPT 4 is even bigger and the next generations of stuff they're working on is an order of magnitude bigger than that. These are trained on a supercomputer somewhere, it's a truly impressive piece of hardware. The price tag on that entire server infrastructure, we're talking tens of millions of dollars just for the server racks.
Transcript
Play full episode