Tech Won't Save Us cover image

Tech Won't Save Us

Patreon Preview: The Harms of Generative AI w/ Alex Hanna

Feb 17, 2025
Delve into the intricate world of generative AI as experts unpack the computational demands that drive these models. Discover how crucial specialized hardware, like NVIDIA GPUs, supports the complex calculations involved. The discussion critiques the rising costs and energy challenges associated with generative AI, painting a stark picture of sustainability as usage escalates. This eye-opening conversation reveals the hidden infrastructure strains that accompany the fascination with AI technology.
05:52

Podcast summary created with Snipd AI

Quick takeaways

  • Generative AI's computational intensity arises from extensive training processes requiring specialized hardware, significantly driving up energy consumption and costs.
  • The rapid growth of AI applications challenges assumptions about cost optimization, highlighting sustainability concerns due to the increasing demand for computational resources.

Deep dives

Computational Intensity of AI Models

Generative AI models are computationally intensive due to their large size and complex training processes. The training involves backpropagation, which necessitates extensive matrix multiplication operations, relying heavily on specialized hardware like GPUs. Companies like NVIDIA have seen increased market demand for their GPUs as a result, although the market is currently experiencing fluctuations. Both the training and inference phases of these models require substantial computational power, impacting energy consumption significantly.

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode