Grit cover image

#200 CEO & Co-Founder Together AI, Vipul Ved Prakash w/ Bucky Moore: Super Cycle

Grit

00:00

The Expensive Nature of Generative AI Core Operations

Generative AI core operations are remarkably expensive due to the immense computational power required for machines to generate text. This new era in computing signifies a shift from machines simply looking up information to actively thinking, necessitating substantial compute and energy resources. Some analysts speculate that the current expenses on GPUs for AI operations might be challenging to recover in the future, although not all GPUs are solely dedicated to foundation models.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app