AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Chinchilla - The Latest Version of GPT Three
Chinchilla is the latest version of GPT three, but a token processor that was trained on less data. If we take Chinchilla's 70 billion parameters trained on 1.4 trillion tokens and we use 1 million GPT threes of compute to push it to 70 trillion parameters with 1.4 quadrillion tokens, am I highly confident it will remain weak and safe? Because right now, all these token predictors are pretty weak and pretty safe compared to, you know, humans. No, no, I am not.