3 ms·

I'm a hobbyist IT enthusiast, not a professional computer guy, but from my point of view there's a big difference between a bunch of servers hosting something p

I'm a hobbyist IT enthusiast, not a professional computer guy, but from my point of view there's a big difference between a bunch of servers hosting something people want, like Netflix, and a warehouse full of GPUs running around the clock to make Lobster Jesus or whatever. It's also a proxy for people's feelings on AI--essentially the only way people have to fight back against the new technology that makes eternal garbage and is supposedly coming for their jobs is to push for banning "data centers."

mfnfnnf 1mo ago
[dead]
babelfish 1mo ago
Totally agree that it's just a proxy for people's feelings on AI, but my Lobster Jesus is much more important to me than a Netflix show! All of the datacenter usage (for inference) is just serving something people want. Time has already shown that the datacenter for training is also just creating something people want.
- K0balt 1mo ago
  Lobster Jesus FTW.
- ipdashc 1mo ago
  > All of the datacenter usage (for inference) is just serving something people want. I agree with this in principle, but I wonder how asymmetric the usage is. When I hear about developers dropping $200/mo (subsidized!) on AI coding, and having multiple agents on supergigaultramax effort churning on stuff for hours... Versus your average person maybe asking a few chatgpt questions every day or week... IDK. Like others have said, yes, OpenAI probably isn't literally going to sell you more than $200 of electricity for $200/mo. But data centers get industrial rates, and $200 of power is still a decent bit of power just to be churning out slop! (It's about a monthly home bill and EV charging cost combined) And some companies spend way more than that on API pricing for tokens... It's just hard to get a handle on where the usage is actually going. I just wish we could pass a common sense law to require them all to build renewables. It's literally electricity, it's the easiest energy to decarbonize.
  - whimsicalism 1mo ago
    i think this sentiment comes from a deep misunderstanding of how our modern society is the product of transitive satisfaction of wants. the developers churning out agent work on supergigaultramax effort are fulfilling the transitive preferences of people like supply chain managers, etc. who are in turn fulfilling the transitive preferences of a school teacher for cheap groceries, who are in turn.... This is how economies work and the alternative strategy of enumerating morally correct wants/needs and assigning the correct price from on-high has been a demonstrable failure. It is a cognitive failure of humanity that this strategy is so intuitively appealing to us.
    - ipdashc 1mo ago
      > the developers churning out agent work on supergigaultramax effort are fulfilling the transitive preferences of people like supply chain managers, etc. Sure, but that's the crux of it all, isn't it. Are they? And are they doing it that much better than before? I'm far from an AI coding skeptic at this point, the stuff works, and I use it, but I think it's fair to ask whether it's worth burning a middle class home's amount of electricity to spit out CRUD apps and web frontends a bit faster. As many have pointed out, we've still yet to see some kind of huge productivity increase in society at large, or even some particularly revolutionary new app or whatever. On some level it's people's money and they can spend it how they want, but people get criticized for unnecessary waste of resources all the time.
      - whimsicalism 1mo ago
        I think people should be allowed to do things, generally. If it's not worth it, the people doing it will go out of business (and quickly, at these prices). I think it is likely more worth it than you realize. We're not talking about criticizing, we're talking about bans.
        ipdashc 1mo ago
        > If it's not worth it, the people doing it will go out of business In general I agree (and many environmentalists and such undervalue the fact that environmental waste often correlates with wasted money), but I don't think this is a reliable principle. You can always brute force your way though problems, sometimes it's cheaper that way, doesn't mean it's not wasteful. We are also assuming that economic value means something is good for society. A lot of money is made off of social media, ads, gambling apps, clearly there's demand for it. I don't think that means we can say all those things are good, just off demand alone. I'm not really talking about banning anything, I just think it should be asked whether this stuff is worth it. We're just two guys on the Internet, it doesn't really matter at the end of the day.
jack_h 1mo ago
How is there a big difference between those two things? People want Netflix, people also want the output of AI whether that is lobster Jesus or something else. This seems more like substituting what people want, which clearly includes AI, for what some people think others should want. I can guarantee you there are people who don’t want Netflix and think it’s a waste of resources that encourage people to binge TV, become a couch potato, and end up being drags on the healthcare system. Should their preferences override those who do want it?
- dylan604 1mo ago
  > How is there a big difference between those two things? Netflix just serves existing data so their biggest need is data storage ala CDN for closer retrieval to the user. Very low requirements. Creating sweet baby lobster jesus requires incredible amounts of computer/power/cooling. The requirements are totally different. Yes, both ultimately deliver pixels to consumer's eyeballs, but how they get there are so different that it's laughable that people cannot see the difference.
- harimau777 1mo ago
  I think that potentially the difference is that, while people do in some sense want AI, they don't want it in the same way that they want Netflix. I'd compare it to Amazon: it perfectly possible for people to like the ability to like 2 day shipping while also liking that the site is flooded in cheap crap. So maybe it is that people like AI in certain domains but HATE the way that it is being used overall?
- AlexAplin 1mo ago
  Democracy, even at its most ideal, is often about overriding preferences. Netflix helps to float an entire industry of creators and a tangible pop culture. It's not entirely clear (or softened, maybe not clear to communities) what AI build out floats currently except AI companies and the tangible negatives of generative AI.
  - Panzer04 1mo ago
    Look, I'm not entirely convinced AI will be as revolutionary as some believe but it's still pretty clear it's able to provide capabilities we've never had before. Dismissing it entirely is pretty hard to justify.
dylan604 1mo ago
The conflating of a data center and an AI/GPU farm is disingenuous at best, and the AI people know what they are doing. None of the "traditional" data centers are being powered on site with gas turbine generators. New GPU farms are also being designed with much larger footprints with much more needs from the public utilities.
xavdid 1mo ago
There's also different building pressures. Before, companies would want to build / power / maintain the smallest amount of data center hardware they could while still serving their needs. Overprovisioning just meant worse opex number. Now, because supply is so constrained relative to demand, there's no limit. More is always better, which leads to a crazy amount of construction (as its negative effects).
EdiX 1mo ago
> there's a big difference between a bunch of servers hosting something people want, like Netflix, and a warehouse full of GPUs running around the clock to make Lobster Jesus or whatever. ChatGPT has been the most downloaded app every month for a year and a half.
- nancyminusone 1mo ago
  It's gotta be something. The actual apps I use to do work on my phone either were included in the OS or downloaded long ago.
- goatlover 1mo ago
  That doesn't mean people want LLMs to replace their jobs so they can (hopefully) go on welfare, and to have ever more data enters built with that goal in mind.
  - EdiX 1mo ago
    They don't want them to replace their job, they want them to replace other peoples jobs.
    - watwut 1mo ago
      Actually, no. Actually most people do not want everyone else to be jobless or suffer etc. There are subgroups who enjoy harm to others, but most dont.
      - EdiX 1mo ago
        Do most people buy their airplane tickets at a physical travel agent? Do they do most of their shopping at physical stores? Do they send paper mail instead of email or messages? Do they worry about buying from assembly lines that are least mechanized? Do they buy a car or take a horse carriage? It isn't about hurting others, it's about convenience and price.
        1mo ago
api 1mo ago
You really think Lobster Jesus is what most of this is doing? It's doing code, analytics, training, research, operating services. The silly slop stuff is a small rounding error of usage.
- compass_copium 1mo ago
  Ah, the job-killing stuff, right. Don't forget selecting Iranian girls' schools as targets for missile strikes, AI is doing that, too.

mfnfnnf 1mo ago

[dead]

babelfish 1mo ago

Totally agree that it's just a proxy for people's feelings on AI, but my Lobster Jesus is much more important to me than a Netflix show! All of the datacenter usage (for inference) is just serving something people want. Time has already shown that the datacenter for training is also just creating something people want.

K0balt 1mo ago
Lobster Jesus FTW.
ipdashc 1mo ago
> All of the datacenter usage (for inference) is just serving something people want. I agree with this in principle, but I wonder how asymmetric the usage is. When I hear about developers dropping $200/mo (subsidized!) on AI coding, and having multiple agents on supergigaultramax effort churning on stuff for hours... Versus your average person maybe asking a few chatgpt questions every day or week... IDK. Like others have said, yes, OpenAI probably isn't literally going to sell you more than $200 of electricity for $200/mo. But data centers get industrial rates, and $200 of power is still a decent bit of power just to be churning out slop! (It's about a monthly home bill and EV charging cost combined) And some companies spend way more than that on API pricing for tokens... It's just hard to get a handle on where the usage is actually going. I just wish we could pass a common sense law to require them all to build renewables. It's literally electricity, it's the easiest energy to decarbonize.
- whimsicalism 1mo ago
  i think this sentiment comes from a deep misunderstanding of how our modern society is the product of transitive satisfaction of wants. the developers churning out agent work on supergigaultramax effort are fulfilling the transitive preferences of people like supply chain managers, etc. who are in turn fulfilling the transitive preferences of a school teacher for cheap groceries, who are in turn.... This is how economies work and the alternative strategy of enumerating morally correct wants/needs and assigning the correct price from on-high has been a demonstrable failure. It is a cognitive failure of humanity that this strategy is so intuitively appealing to us.
  - ipdashc 1mo ago
    > the developers churning out agent work on supergigaultramax effort are fulfilling the transitive preferences of people like supply chain managers, etc. Sure, but that's the crux of it all, isn't it. Are they? And are they doing it that much better than before? I'm far from an AI coding skeptic at this point, the stuff works, and I use it, but I think it's fair to ask whether it's worth burning a middle class home's amount of electricity to spit out CRUD apps and web frontends a bit faster. As many have pointed out, we've still yet to see some kind of huge productivity increase in society at large, or even some particularly revolutionary new app or whatever. On some level it's people's money and they can spend it how they want, but people get criticized for unnecessary waste of resources all the time.
    - whimsicalism 1mo ago
      I think people should be allowed to do things, generally. If it's not worth it, the people doing it will go out of business (and quickly, at these prices). I think it is likely more worth it than you realize. We're not talking about criticizing, we're talking about bans.
      - ipdashc 1mo ago
        > If it's not worth it, the people doing it will go out of business In general I agree (and many environmentalists and such undervalue the fact that environmental waste often correlates with wasted money), but I don't think this is a reliable principle. You can always brute force your way though problems, sometimes it's cheaper that way, doesn't mean it's not wasteful. We are also assuming that economic value means something is good for society. A lot of money is made off of social media, ads, gambling apps, clearly there's demand for it. I don't think that means we can say all those things are good, just off demand alone. I'm not really talking about banning anything, I just think it should be asked whether this stuff is worth it. We're just two guys on the Internet, it doesn't really matter at the end of the day.

jack_h 1mo ago

How is there a big difference between those two things? People want Netflix, people also want the output of AI whether that is lobster Jesus or something else. This seems more like substituting what people want, which clearly includes AI, for what some people think others should want. I can guarantee you there are people who don’t want Netflix and think it’s a waste of resources that encourage people to binge TV, become a couch potato, and end up being drags on the healthcare system. Should their preferences override those who do want it?

dylan604 1mo ago
> How is there a big difference between those two things? Netflix just serves existing data so their biggest need is data storage ala CDN for closer retrieval to the user. Very low requirements. Creating sweet baby lobster jesus requires incredible amounts of computer/power/cooling. The requirements are totally different. Yes, both ultimately deliver pixels to consumer's eyeballs, but how they get there are so different that it's laughable that people cannot see the difference.
harimau777 1mo ago
I think that potentially the difference is that, while people do in some sense want AI, they don't want it in the same way that they want Netflix. I'd compare it to Amazon: it perfectly possible for people to like the ability to like 2 day shipping while also liking that the site is flooded in cheap crap. So maybe it is that people like AI in certain domains but HATE the way that it is being used overall?
AlexAplin 1mo ago
Democracy, even at its most ideal, is often about overriding preferences. Netflix helps to float an entire industry of creators and a tangible pop culture. It's not entirely clear (or softened, maybe not clear to communities) what AI build out floats currently except AI companies and the tangible negatives of generative AI.
- Panzer04 1mo ago
  Look, I'm not entirely convinced AI will be as revolutionary as some believe but it's still pretty clear it's able to provide capabilities we've never had before. Dismissing it entirely is pretty hard to justify.

dylan604 1mo ago

The conflating of a data center and an AI/GPU farm is disingenuous at best, and the AI people know what they are doing. None of the "traditional" data centers are being powered on site with gas turbine generators. New GPU farms are also being designed with much larger footprints with much more needs from the public utilities.

xavdid 1mo ago

There's also different building pressures. Before, companies would want to build / power / maintain the smallest amount of data center hardware they could while still serving their needs. Overprovisioning just meant worse opex number. Now, because supply is so constrained relative to demand, there's no limit. More is always better, which leads to a crazy amount of construction (as its negative effects).

EdiX 1mo ago

> there's a big difference between a bunch of servers hosting something people want, like Netflix, and a warehouse full of GPUs running around the clock to make Lobster Jesus or whatever. ChatGPT has been the most downloaded app every month for a year and a half.

nancyminusone 1mo ago
It's gotta be something. The actual apps I use to do work on my phone either were included in the OS or downloaded long ago.
goatlover 1mo ago
That doesn't mean people want LLMs to replace their jobs so they can (hopefully) go on welfare, and to have ever more data enters built with that goal in mind.
- EdiX 1mo ago
  They don't want them to replace their job, they want them to replace other peoples jobs.
  - watwut 1mo ago
    Actually, no. Actually most people do not want everyone else to be jobless or suffer etc. There are subgroups who enjoy harm to others, but most dont.
    - EdiX 1mo ago
      Do most people buy their airplane tickets at a physical travel agent? Do they do most of their shopping at physical stores? Do they send paper mail instead of email or messages? Do they worry about buying from assembly lines that are least mechanized? Do they buy a car or take a horse carriage? It isn't about hurting others, it's about convenience and price.
      - 1mo ago

api 1mo ago

You really think Lobster Jesus is what most of this is doing? It's doing code, analytics, training, research, operating services. The silly slop stuff is a small rounding error of usage.

compass_copium 1mo ago
Ah, the job-killing stuff, right. Don't forget selecting Iranian girls' schools as targets for missile strikes, AI is doing that, too.