LLMs are a tiny energy use, 100 queries to chatGPT type models use about as much energy as a hair dryer for a few minutes. At current UK electricity retail prices (after tax, so significantly more than datacentres pay) 1 query costs somewhere between £0.00015 - £0.001 in power usage.
I cant see that being a significant factor in the price power companies charge over things like moving away from cheap but dirty sources of power or fluctuations of the natural gas price.
The median query is small. There are a LOT of queries because they’re being generated by machines, not just people, and the average energy use per query is likely far larger than the median, hence the decision by Google to publish the median instead.
Sure maybe that’s all true, but even if you make insane assumptions like every single person in the UK is making 100 queries per week, and that the true average cost is 10 times higher than the 3Wh I used for my upper price limit there (this is far more than independent research suggests), and that data centres are paying retail price + taxes: It still only comes out to around 5% of the UK domestic electricity market, so hardly going to be responsible for huge shifts in prices.
LLMs are a tiny energy use, 100 queries to chatGPT type models use about as much energy as a hair dryer for a few minutes. At current UK electricity retail prices (after tax, so significantly more than datacentres pay) 1 query costs somewhere between £0.00015 - £0.001 in power usage.
I cant see that being a significant factor in the price power companies charge over things like moving away from cheap but dirty sources of power or fluctuations of the natural gas price.
The median query is small. There are a LOT of queries because they’re being generated by machines, not just people, and the average energy use per query is likely far larger than the median, hence the decision by Google to publish the median instead.
Sure maybe that’s all true, but even if you make insane assumptions like every single person in the UK is making 100 queries per week, and that the true average cost is 10 times higher than the 3Wh I used for my upper price limit there (this is far more than independent research suggests), and that data centres are paying retail price + taxes: It still only comes out to around 5% of the UK domestic electricity market, so hardly going to be responsible for huge shifts in prices.