AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
2min snip
Stable Diffusion and LLMs at the Edge with Jilei Hou - #633
The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
The Importance of Quantization in Language Models
Different types of models require different levels of compression and quantization./nLanguage models can be compressed more aggressively compared to vision models./nLLM (Large Language Models) can be compressed down to four bits or even less./nSmaller bit width enables large language models to be brought to devices./nQuantization is an important area to stay ahead and bring value to the industry./nExpect new announcements in the second half of the year from the research, engineering, and product teams.
00:00
Transcript
Episode notes
Get the Snipd
podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any
moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share
& Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode