Get the app
Stephen Merity
NLP and deep learning researcher working on a startup called DDX Times. Focused on unlocking language as a data set and using language models to analyze large amounts of text.
Best podcasts with Stephen Merity
Ranked by the Snipd community
Dec 12, 2019
• 59min
Single Headed Attention RNN: Stop Thinking With Your Head with Stephen Merity - #325
chevron_right
Stephen Merity, an NLP and deep learning researcher at DDX Times, shares insights into his innovative work on Single Headed Attention RNNs. He delves into his motivations for developing this model and contrasts it with conventional transformers. Merity emphasizes the importance of efficient model benchmarking, revealing how he made training accessible on a single GPU. He also discusses the significance of diversifying AI research, encouraging exploration beyond just large models. Plus, he reflects on the balance between academic writing and accessibility.
The AI-powered Podcast Player
Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
Get the app
