Industrial AI Podcast cover image

Industrial AI Podcast

xLSTM - "I am almost exploding"

Oct 18, 2023
Prof. Dr. Sepp Hochreiter discusses xLSTM, the European answer to ChatGPT and Co. He compares xLSTM to transformers, highlighting its speed and parallel word processing capabilities. The advantages and limitations of LSTM and the introduction of xLSTM as an improved version are explored. Criticism surrounding large language models and the goal of securing 300 million euros for the project are discussed. The structural differences between LSTM and xLSTM and their potential in engineering applications are also explored.
21:22

Episode guests

Podcast summary created with Snipd AI

Quick takeaways

  • XLSTM combines the advantages of transformer and LSTM models, improving on transformer technologies and outperforming them in terms of sensitivity on small datasets.
  • XLSTM has potential applications in engineering topics such as process control and logistics, with the ability to store words precisely, capture semantic meaning, and provide global context, making it superior in various domains.

Deep dives

Insight 1: The development of XLSTM as an improved technology

XLSTM is presented as an improved technology that combines the advantages of transformer and LSTM models. The speaker explains that transformer technology offers fast training and the ability to process words in parallel, while LSTM excels in abstraction and extracting important characteristics but struggles with precise word storage. Through XLSTM, the speaker aims to enhance LSTM by incorporating exponential gating and vectorization techniques, resulting in a model that improves upon transformer technologies and outperforms them in terms of sensitivity when tested on small datasets.

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode