How a lot electrical energy does ChatGPT use to reply one query?
This text presents a spread inside which the electrical energy consumption per question of ChatGPT could fall and compares it to the measured power consumption of two different giant language fashions (LLMs).
That is an attention-grabbing endeavor for 2 causes:
To start with, if organizations know the way a lot electrical energy ChatGPT requires to reply one query, they’ll approximate the carbon footprint related to their use of ChatGPT or comparable providers corresponding to OpenAI’s LLM APIs.
For greater than 50,000 European companies, this will likely quickly grow to be extremely related, as the approaching Company Social Accountability Directive (CSRD) will possible drive them to reveal scope 3 emissions of their administration stories [1]. I count on utilization of providers like ChatGPT to fall beneath scope 3 as a result of cloud compute is taken into account to be scope 3 [2]. I hope this text can present inspiration for the way to estimate your group’s scope 3 emissions from ChatGPT and comparable providers.
One more reason why it’s attention-grabbing to look into ChatGPT’s power use per question is that it’ll allow people to give you their very own estimates of ChatGPT’s complete electrical energy consumption or carbon footprint. As such, I hope this weblog submit will encourage others to publish comparable work.
Within the the rest of this text, the phrases “question” and “request” shall be used interchangeably.
On this part, I’ll current the methodology used to supply estimates of ChatGPT’s electrical energy consumption per question. The estimates depend on two completely different strategies:
- One by which we estimate the overall power consumption of the {hardware} ChatGPT presumably is operating on and divide by the assumed variety of each day queries
- One by which we use the reported…
