Adept's Fuyu 8B: Advancements in Multimodal AI

Our 142nd episode with a summary and discussion of last week's big AI new.

Apologies for this one coming out after a pause, episodes will resume being released regularly as of this week.

Read out our text newsletter and comment on the podcast at https://lastweekin.ai/

Email us your questions and feedback at contact@lastweekin.ai

Timestamps + Links:

• (00:00) Intro / Banter
• Tools & Apps
  • (03:00) Introducing PlayHT 2.0 Turbo ⚡️ - The Fastest Generative AI Text-to-Speech API
  • (07:15) YouTube Music now lets you make your own playlist art with AI
  • (09:23) Sick of meetings? Microsoft’s new AI assistant will go in your place
  • (11:54) Anthropic brings Claude AI to more countries, but still no Canada (for now)
•  Applications & Business
  • (14:55) Humanoid robots face a major test with Amazon’s Digit pilots
  • (18:40) Figure 01 humanoid takes first public steps
  • (22:31) AI-generating music app Riffusion turns viral success into $4M in funding
  • (23:35) ChatGPT Creator Partners With Abu Dhabi’s G42 in Middle East AI Push
  • (25:00) AMD Scores Two Big Wins: Oracle Opts for MI300X, IBM Asks for FPGAs
  • (26:38) Alibaba, Tencent among investors in China’s rival to OpenAI with $341 million funding
  • (30:35) AI companies drive demand for office space in tech hubs, new study finds
  • (32:13) OpenAI is in talks to sell shares at an $86 billion valuation
• Projects & Open Source
  • (35:00) Introducing Video-To-Text and Pegasus-1 (80B)
  • (39:35) Adept Releases Fuyu-8B for Multimodal AI Agents
  • (42:03) MiniGPT-v2: large language model as a unified interface for vision-language multi-task learning
  • (44:53) Meta’s Habitat 3.0 simulates real-world environments for intelligent AI robot training
  • (48:22) DeepMind UniSim simulates reality to train robots, game characters 
  • (49:13) Jina AI Launches World's First Open-Source 8K Text Embedding, Rivaling OpenAI
  • (51:13) Llemma: An Open Language Model For Mathematics
• Research & Advancements
  • (53:22) Eliciting Human Preferences with Language Models
  • (57:23) New Nvidia AI agent, powered by GPT-4, can train robots
  • (01:01:38) Unveiling the General Intelligence Factor in Language Models: A Psychometric Approach
  • (01:04:48) AgentTuning: Enabling Generalized Agent Abilities for LLMs
  • (01:09:51) Contrastive Prefence Learning: Learning from Human Feedback without RL
  • (01:11:25) ‘Mind-blowing’ IBM chip speeds up AI 

• Policy & Safety
  • (01:14:57)  GM Cruise unit suspends all driverless operations after California ban
  • (01:18:52) AI researchers uncover ethical, legal risks to using popular data sets
  • (01:22:22) AI Safety Summit: day 1 and 2 programme
  • (01:25:23) Anthropic's AI chatbot Claude is posting lyrics to popular songs, lawsuit claims
  • (01:26:38) Mike Huckabee says Microsoft and Meta stole his books to train AI
  • (01:27:10) Clearview AI Successfully Appeals $9 Million Fine in the U.K.
  • (01:28:11) North Korea experiments with AI in cyber warfare: US official
  • (01:30:17) OpenAI forms new team to assess ‘catastrophic risks’ of AI
  • UK poised to establish global advisory group on AI
• Synthetic Media & Art
  • (01:32:22) This new data poisoning tool lets artists fight back against generative AI
  • (01:34:32) Amazon now lets advertisers use generative AI to pretty up their product shots
  • (01:36:36) The Beatles: ‘final’ song Now and Then to be released thanks to AI technology