this post was submitted on 23 Apr 2025
624 points (92.6% liked)
196
5125 readers
1500 users here now
Be sure to follow the rule before you head out.
Rule: You must post before you leave.
Other rules
Behavior rules:
- No bigotry (transphobia, racism, etc…)
- No genocide denial
- No support for authoritarian behaviour (incl. Tankies)
- No namecalling
- Accounts from lemmygrad.ml, threads.net, or hexbear.net are held to higher standards
- Other things seen as cleary bad
Posting rules:
- No AI generated content (DALL-E etc…)
- No advertisements
- No gore / violence
- Mutual aid posts are not allowed
NSFW: NSFW content is permitted but it must be tagged and have content warnings. Anything that doesn't adhere to this will be removed. Content warnings should be added like: [penis], [explicit description of sex]. Non-sexualized breasts of any gender are not considered inappropriate and therefore do not need to be blurred/tagged.
Also, when sharing art (comics etc.) please credit the creators.
If you have any questions, feel free to contact us on our matrix channel or email.
Other 196's:
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Following for the results of your work here so I can use it in the future.
From this 2023 paper, looks like if all Nvidia AI servers are running 24/7, you'd get an energy consumption of about 5.7–8.9 TWh per year. Nvidia servers make up 95% of the AI market (according to the paper) so that'd be pretty close to what AI servers would consume.
The paper also estimates about 20% of crypto mining GPUs no longer mining etherium converted to AI, which contributed another 16.1 TWh per year.
This doesn't include some AI, but it should be the majority.
Between those two sources, that gives 23.4 TWh per year. That gives 0.08 exta joules per year per this converter. That's 22% of Sri Lanka's energy consumption (which is the lowest country).
So AI in a year uses at much energy as Sri Lanka uses in 3 months. At least in 2023. I'll see if I can find a more recent study.
So that assumes AI requests use 100 percent of the hardware 100 percent of the time.
Yes, but those servers are pretty ai specific, so that's a decent assumption. Looks like Nvidia is drastically ramping up production of these servers, so current electricity use might be about 10x, I'm working on it.
100% utilization 100% of the time? That seems like an unlikely figure, right?
100% utilization yes, but server uptimes are in the 99 percent range.
Idle consumption vs full utilization consumption are two very different things, though - this will have a large impact on the final number.
This is the kind of comment I love on Lemmy.
There's plenty of countries missing from that rankings list, and I bet those are the ones using less energy. Especially considering microstates like Vatican, the statement could be technically correct
I can't find any info on Vatican City's energy use, but possibly. You could go even further and compare to not widly recognized countries like sealand, where you have the energy consumption of a residential house or two. But that would be wildly misleading.