
#60 – Jaime Sevilla on Trends in Machine Learning
Hear This Idea
The Improvements in Machine Learning Architectures
Transformer architecture has been this really general architecture that has overtaken like many fields in artificial intelligence. Another big, another improvement was the improvement in like the activation of something in neural networks. We have replaced what's called a rectified linear unit, which essentially you just take like, you just take like the neuron and do you just leave it at this. It's a very simple operation. It requires like very little computation.
00:00
Transcript
Play full episode
Remember Everything You Learn from Podcasts
Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.