AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
The Energy Consumption Divide in AI Models
This chapter explores the disparity in energy consumption between generative and extractive AI models, emphasizing the challenges and implications of deploying AI models in large-scale production systems. The discussion includes a study analyzing 90 models to compare energy usage based on model size, task specificity, and deployment costs. Trends towards smaller and more efficient models are examined, pointing towards a shift in the energy landscape of AI deployment.