Revising AI Benchmarking Standards for Enhanced Performance Evaluation

Our 179th episode with a summary and discussion of last week's big AI news!

With hosts Andrey Kurenkov (https://twitter.com/andrey_kurenkov) and Jeremie Harris (https://twitter.com/jeremiecharris)

If you would like to get a sneak peek and help test Andrey's generative AI application, go to Astrocade.com to join the waitlist and the discord.

Read out our text newsletter and comment on the podcast at https://lastweekin.ai/

If you would like to become a sponsor for the newsletter, podcast, or both, please fill out this form.

Email us your questions and feedback at contact@lastweekinai.com and/or hello@gladstone.ai

Episode Highlights:

- Grok 2's beta release features new image generation using Black Forest Labs' tech.

- Google introduces Gemini Voice Chat Mode available to subscribers and integrates it into Pixel Buds Pro 2.

- Huawei's Ascend 910C AI chip aims to rival NVIDIA's H100 amidst US export controls.

- Overview of potential risks of unaligned AI models and skepticism around SingularityNet's AGI supercomputer claims.

Timestamps + Links:

• (00:00:00) Intro / Banter
• (00:02:15) Response to listener comments / corrections
• Tools & Apps
  • (00:04:24) Grok-2 is out in beta, now with added AI image generation
  • (00:11:28) OpenAI reveals an updated GPT-4o model - but can't quite explain how it's better
  • (00:13:48) Google Gemini’s voice chat mode is here
  • (00:16:18) Google’s Pixel Buds Pro 2 bring Gemini to your ears
  • (00:19:55) Google’s AI-generated search summaries change how they show their sources
  • (00:23:13) Prompt Caching is Now Available on the Anthropic API for Specific Claude Models
• Applications & Business
  • (00:26:56) Meet Black Forest Labs, the startup powering Elon Musk’s unhinged AI image generator
  • (00:26:56) Huawei readies new AI chip to challenge Nvidia in China, WSJ reports
  • (00:37:53) ASML and Imec Announce High-NA Lithography Breakthrough
  • (00:43:07) Chinese startup WeRide gets nod to test robotaxis with passengers in California
  • (00:45:49) Perplexity’s popularity surges as AI search start-up takes on Google
  • (00:51:55) Lisa Su formally welcomes Silo AI team to AMD after completing $665 million acquisition
• Projects & Open Source
  • (00:54:31) FalconMamba 7B Released: The World’s First Attention-Free AI Model with 5500GT Training Data and 7 Billion Parameters
  • (00:59:25) OpenAI has introduced SWE-bench Verified to evaluate AI performance
  • (01:04:21) Nous Research presents Hermes 3
    
  • (01:11:07) New supercomputing network could lead to AGI, scientists hope, with 1st node coming online within weeks
• Research & Advancements
  • (01:14:40) The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery
  • (01:30:24) Imagen 3
  • (01:32:48) The Data Addition Dilemma
  • (01:37:35) LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMs
• Policy & Safety
  • (01:40:55) MIT researchers release a repository of AI risks
  • (01:44:14) Elon Musk addresses power issues at xAI supercomputer facility in Memphis
  • (01:46:52) FCC Proposes New Rules on AI-Powered Robocalls
  • Governments Adjust Policies Amid Flood of AI Record Requests
• Synthetic Media & Art
  • (01:48:21) SAG-AFTRA Strikes Groundbreaking AI Digital Voice Replica Pact With Startup Firm Narrativ
  • (01:51:52) How ‘Deepfake Elon Musk’ Became the Internet’s Biggest Scammer
• (01:56:21) AI Song Outro