klier
Premium
Math says so -
A RTX 4090 GPU sustained load is ~400 watts. So one of them running SDXL continuously for a day would consume .4kwh * 24 = 9.6 kwh/day.
An avg human adult including lifestyle consumption in the developed world consumes ~90 kwh/day. Source
So a GPU consumes ~10x < energy than the avg adult human.
And that is not even counting the non-productive years of a human life. Yes, humans are terribly inefficient machines if you reduce them to their mere physical output. But fortunately, we are so much much more than that.
Exactly. But these LLMs clearly do not use just one GPU. And the datacenters also don't work with off the shelf consumer graphics cards. Those are the H100 etc cards.