GPT-4 Info LEAKED: Cost, Weights and 1.8T Perimeters
AI Chat: ChatGPT, AI News, Artificial Intelligence, OpenAI, Machine Learning
00:00
GPT4's 1.8 Twelfth Parameters
GPT4 has 1.8 trillion parameters, which is more than the size of its predecessor GPT3. It includes what's called a mixture of experts or an MOE model. The strategy is a bit like having different departments in a company and they confirmed that I was using 16 experts in this model. This is the 30 second overview on a technical perspective.
Play episode from 04:13
Transcript
