Hear This Idea cover image

#60 – Jaime Sevilla on Trends in Machine Learning

Hear This Idea

00:00

The Improvements in Machine Learning Architectures

Transformer architecture has been this really general architecture that has overtaken like many fields in artificial intelligence. Another big, another improvement was the improvement in like the activation of something in neural networks. We have replaced what's called a rectified linear unit, which essentially you just take like,  you just take like the neuron and do you just leave it at this. It's a very simple operation. It requires like very little computation.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app