AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Deep Learning Is Hitting a Wall
GPT-3 was trained only on 2021. It didn't know what happened in 2022. So if you use a pure language model, it simply won't be up to date. And so you get really weird things coming out of it. As recently as November of 2022, Facebook had a system or meta had a system called Galactica that said Elon Musk died in a car crash and he didn't actually die in car crash.