AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
The Middle Ground Between Rayleigh and Sigmoids
GPT4 is a big leap from GPT-3, but it's still not quite on the same scale as RNNs. There are hundreds of thousands of little hacks that improve the system and some could be non-linear jump in performance. But there have been simple breakthroughs like Rayleigh's over Sigmoids for neural networks.