The podcast delves into 2024's AI chip landscape, highlighting NVIDIA's impressive grip on the market, with a staggering percentage of research papers relying on their technology. It compares this dominance to emerging competitors like Google and Cerebras, shedding light on investment trends. The discussion also touches on the evolving performance metrics of various AI chip manufacturers, offering insights into the competitive dynamics shaping the future of AI research.
NVIDIA's chips dominated AI research with 91% of published papers in 2024, reflecting the company's significant influence in the field.
Emerging competition in the AI chip market is evident with Google's TPU usage skyrocketing by nearly 1,000%, showcasing broader adoption.
Deep dives
NVIDIA's Dominance in AI Research
NVIDIA continues to dominate the AI research landscape, accounting for a staggering 91% of all chip usage in published AI papers as of 2024. The company’s chips, including the popular A100 and the rapidly growing H100, collectively contributed to 44,389 published papers that year. This overwhelming majority highlights NVIDIA's longstanding influence and the impact of its technology on AI development, overshadowing competitors such as Google, AMD, and several startups. Investors who placed $6 billion in AI chip competitors from 2016 to 2024 would have earned only a fraction of what they would have had they chosen to invest in NVIDIA instead.
Emerging Competitors and Growth Trends
Despite NVIDIA's dominance, there are signs of emerging competition within the AI chip market. Google's TPU usage saw an impressive growth of nearly 1,000% year-over-year, culminating in 1,702 papers published in 2024, signaling increased adoption. Companies like Cerebras and Grok are also making strides, with Cerebras launching its inference service and consistently ranking high in AI research papers. Grok, founded by members of the original Google TPU team, has rapidly gained traction and is now a notable contender in the crowded inference market.
Final 2024 statistics for AI chip usage across NVIDIA, Google, Huawei, Apple, AMD, Cerebras, Cambricon, Graphcore, Groq, SambaNova, and Intel Habana in the State of AI Report Compute Index.
Get the Snipd podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered podcast player
Listen to all your favourite podcasts with AI-powered features
Discover highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share & Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered podcast player
Listen to all your favourite podcasts with AI-powered features
Discover highlights
Listen to the best highlights from the podcasts you love and dive into the full episode