2min snip

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) cover image

Unifying Vision and Language Models with Mohit Bansal - #636

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

NOTE

Efficient Representation in Video and Language Models

Efficiency in video and language models differs in terms of senses and engineering. While more information can be packed in a video for human learning, representing videos currently is cumbersome. The focus is on making video and language models more efficient by using specific keyframes and deciding which parts need video or just audio. The emergence of transformers as a standard substrate for machine learning applications is enabling advancements in multi-modality unification. The work done on VLT5 in 2021 started in early 2020, exploring different levels of unification in video and language models.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode