#150 - GPT Store, new Nvidia chips, DeepMind’s robotics progress, bad uses of AI

Last Week in AI

Efficiency of State-Space Models and Mixture of Experts in AI Architecture

4min Snip

00:00

Play full episode

Summary

Transcript

Episode notes

State-space models offer linear time inference with respect to context length, making them more computationally feasible compared to transformers. By combining state-space models with mixture of experts technique, the recent Mamba model showcased improved performance compared to both original Mamba model and transformers. This combination increases the model's power without significantly increasing computational costs, making it a promising approach for more efficient AI architecture. The integration of these two techniques could potentially lead to better models and scalability in AI architecture, providing a cost-effective solution for model development and training.

Our 150th episode with a summary and discussion of last week's big AI news!

Read out our text newsletter and comment on the podcast at https://lastweekin.ai/

Email us your questions and feedback at contact@lastweekin.ai

Timestamps + links:

(00:00:00) Intro / Banter
Tools & Apps
- (00:02:49) OpenAI’s custom GPT Store is now open for business
- (00:06:52) OpenAI debuts ChatGPT subscription aimed at small teams
- Lighting round
Applications & Business
- (00:14:24) Nvidia's newest chips are designed to run AI at home as competition from Intel, AMD looms
- (00:16:52) Valve opens the door to more Steam games developed with AI
- Lighting round
  - (00:19:16) AI-powered search engine Perplexity AI, now valued at $520M, raises $73.6M
  - (00:21:33) Waymo will start testing robotaxis on Phoenix highways
  - (00:23:24) Getty and Nvidia bring generative AI to stock photos
Research & Advancements
- (00:25:10) DeepMind is trying to train robots for real-world activities
- (00:29:03) MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts
- Lighting round
  - (00:33:18) PIXART-δ: Fast and Controllable Image Generation with Latent Consistency Models
  - (00:35:20) InseRF: Text-Driven Generative Object Insertion in Neural 3D Scenes
  - (00:37:06) The Impact of Reasoning Step Length on Large Language Models
  - (00:39:33) Mixtral of Experts
Policy & Safety
- (00:40:38) Meta and OpenAI have spawned a wave of AI sex companions—and some of them are children
- (00:46:30) ‘Impossible’ to create AI tools like ChatGPT without copyrighted material, OpenAI says
- Lighting round
  - (00:49:52) Judges in England and Wales are given cautious approval to use AI in writing legal opinions
  - (00:51:43) Hallucinating Law: Legal Mistakes with Large Language Models are Pervasive
Synthetic Media & Art
- (00:55:09) A list going viral reveals famous artists whose work was used to train AI generator
- (00:58:28) YouTube is cracking down on AI-generated true crime deepfakes
- Lighting round

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.

App store banner

Play store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode