AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
How to Train a Dorn Bench
Aims to train models ten times faster so they can generalize better. The trick is starting at a very low learning rate and gradually increasing it. There's a few other little tricks to make it work, but if it aveit basically we can reliably get super convergence.