GPU cloud powers AI with Nvidia chips, scalability challenges for companies like CoreWeave.
Intel's deepfake detection uses AI and Xeon processors to combat misinformation in videos.
AI compute demand surges with chip shortages, creating supply chain hurdles for infrastructure providers.
Deep dives
Bank of America's Expansion in Paris Post-Brexit
Bank of America expanded operations in Paris in 2019 to ensure seamless service to European clients post the Brexit vote. Vanessa Holtz, CEO of Bank of America Securities, aimed to offer a comprehensive service in Paris, becoming a one-stop shop for clients.
The Rising Impact of Deepfake Videos
Deepfake videos are becoming increasingly prevalent in social media and news, challenging perceptions of truth. Intel has developed the world's first real-time deepfake detection platform using AI and Xeon processors to analyze subtle cues in videos to differentiate real from fake content.
Challenges in Scaling AI Infrastructure
The demand for AI compute infrastructure is growing rapidly, but supply chain disruptions have impacted chip availability. Companies like CoreWeave face challenges in rapidly scaling and planning for future market demands due to delays in chip supply.
The Importance of Developing AI Ecosystems
NVIDIA has strategically built an ecosystem around its chip technology to create a moat in the AI market. Partnerships with companies like CoreWeave focus on optimizing chip performance and creating efficient workloads for clients.
Adapting from Cryptocurrency Mining to AI Workloads
CoreWeave transitioned from Ethereum mining to specializing in AI and cloud services. The complexity of running infrastructure for AI differs significantly from cryptocurrency mining, requiring enterprise-grade chips, efficient cooling, and high uptime data centers.
Navigating Supply Chain Disruptions in AI Infrastructure
The current AI infrastructure landscape faces challenges in securing components, planning builds, and meeting demand due to global disruptions. The pace of demand growth exceeds chip availability, leading to delays in infrastructure deployment.
Artificial Intelligence is all the rage right now and most of the investor excitement has so far been focused on the companies providing the hardware and computing power to actually run this new technology. So how does it all work and what does it actually take to run these complex models? On this episode, we speak with Brannin McBee, co-founder of CoreWeave, which provides cloud computing services based on GPUs, the type of chips pioneered by Nvidia and which have now become immensely popular for generative AI. He walks us through the infrastructure involved in powering AI, how difficult it is to get chips right now, who has them, and how the landscape might change in the future.