The Energy Consumption of AI Training

Most of the energy for these is generated in the training process and then when you are actually doing searches, it's heavily decreasing from that point on. It has millions of actually thousands of processors, small processors, and these are very energy-consuming devices. Running this model to generate require that you run these GPUs and if you are serving thousands of users, you need to have multiple of these GPU running 24 hours. That definitely has a significant energy consumption and environmental impact.