Topic: energy variability across queries

Google Reveals AI's Energy Cost Per Prompt for the First Time

Google has disclosed detailed energy consumption data per AI prompt, revealing that its custom TPUs account for only 58% of the total energy used, averaging 0.24 watt-hours per prompt. The remaining energy is consumed by supporting infrastructure, including host CPUs and memory (25%), backup syst...