The AI in Business Podcast cover image

The AI in Business Podcast

[Beyond GPU] Solutions for AI Hardware Challenges from Infrastructure to Deployment - with Mark Heaps of Groq

Sep 9, 2023
33:26
Snipd AI
Mark Heaps, VP of Brand and Creative at Groq, discusses challenges in scaling enterprise AI capabilities and highlights Groq's software-hardware ecosystem as a solution. They explore real-time AI systems, overcoming infrastructure challenges with kernelless systems, the two stages of model development, and understanding challenges in AI model development.
Read more

Podcast summary created with Snipd AI

Quick takeaways

  • Business leaders must consider infrastructure for real-time and fluid natural language processing.
  • Acquiring chips for on-premises deployments can cause delays and hinder rapid deployment.

Deep dives

The Challenges of Building Infrastructure for Enterprise AI

Business leaders face significant challenges when building the infrastructure required to scale enterprise AI capabilities. As the demand for real-time experiences grows, leaders must consider the need for infrastructure that can support real-time and fluid natural language processing for customers. The current Wild West stage of enterprise AI necessitates strategic thinking about infrastructure to serve evolving workloads and end-user expectations.

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode