Hear This Idea cover image

#60 – Jaime Sevilla on Trends in Machine Learning

Hear This Idea

CHAPTER

The Improvements in Machine Learning Architectures

Transformer architecture has been this really general architecture that has overtaken like many fields in artificial intelligence. Another big, another improvement was the improvement in like the activation of something in neural networks. We have replaced what's called a rectified linear unit, which essentially you just take like,  you just take like the neuron and do you just leave it at this. It's a very simple operation. It requires like very little computation.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner