Dan Zhou

Mosharaf Chowdhury, an energy optimization expert from the University of Michigan, and AI researcher Dan Zhou share insights on the energy demands of AI systems. They delve into the substantial energy costs of a single ChatGPT query and examine the surprising dominance of inference energy over training. The duo discusses how GPU inefficiencies and rising demands complicate energy use, while also exploring methods to enhance efficiency and the need for clearer public communication on AI's environmental impact.