3 ms·

I don't know how anyone can look at situations like this and claim letting investors run society is going to yield any rational result for our species.

Noumenon72 2y ago
I look at this and think "wow, I wish I could think big enough to do things at the efficient level even though it's so far outside the easy and 'normal' path." Privileging an arbitrary intuition like "AI should use less electricity than a city" would be irrational.
- PittleyDunkin 2y ago
  What's irrational is not starting from base values. It's hard to see how AI in its current form gets us any closer to a materially better future.
ben_w 2y ago
The surprise for me is that the industrial and academic leaders, with the exception of Yann LeCun, have been saying loudly and constantly "this is bad and we don't know how to make it not bad" and "it has the potential to kill us all" and "optimising anything too hard without concern for literally all of your other values will break those other things you value", and yet a big part of the response has been people saying "pshaw, you're just saying that to sound cool"… …and the messages that are actually getting to people are data centre resource usage, copyright, and cheating in exams.
- PittleyDunkin 2y ago
  Tbh, I can't follow any of the reasoning that AI is a danger to anyone, except through the traditional form of enabling the worst parts of bureaucracy. I just think it's further evidence of a tremendously wasteful and suicidal society.
  - ben_w 2y ago
    That's one possibility for the harms it may cause. I think there's a reasonable chance that someone who thinks the idea is laughable will, at some point, ask an AI to destroy the world specifically to demonstrate that it can't… actually, that part has already happened*, the questions are: (1) how competent does it have to be at following that instruction to actually do so? (2) What resources would someone have to allow it to access (deliberately or accidentally) to pull that off? * someone has asked an AI to destroy the world, but I don't know their motivation. Fortunately for everyone, this one was kinda dumb: https://community.openai.com/t/chaosgpt-an-ai-that-seeks-to-destroy-humanity/160028 https://community.openai.com/t/chaosgpt-an-ai-that-seeks-to-...

Noumenon72 2y ago

I look at this and think "wow, I wish I could think big enough to do things at the efficient level even though it's so far outside the easy and 'normal' path." Privileging an arbitrary intuition like "AI should use less electricity than a city" would be irrational.

PittleyDunkin 2y ago
What's irrational is not starting from base values. It's hard to see how AI in its current form gets us any closer to a materially better future.

ben_w 2y ago

The surprise for me is that the industrial and academic leaders, with the exception of Yann LeCun, have been saying loudly and constantly "this is bad and we don't know how to make it not bad" and "it has the potential to kill us all" and "optimising anything too hard without concern for literally all of your other values will break those other things you value", and yet a big part of the response has been people saying "pshaw, you're just saying that to sound cool"… …and the messages that are actually getting to people are data centre resource usage, copyright, and cheating in exams.

PittleyDunkin 2y ago
Tbh, I can't follow any of the reasoning that AI is a danger to anyone, except through the traditional form of enabling the worst parts of bureaucracy. I just think it's further evidence of a tremendously wasteful and suicidal society.
- ben_w 2y ago
  That's one possibility for the harms it may cause. I think there's a reasonable chance that someone who thinks the idea is laughable will, at some point, ask an AI to destroy the world specifically to demonstrate that it can't… actually, that part has already happened*, the questions are: (1) how competent does it have to be at following that instruction to actually do so? (2) What resources would someone have to allow it to access (deliberately or accidentally) to pull that off? * someone has asked an AI to destroy the world, but I don't know their motivation. Fortunately for everyone, this one was kinda dumb: https://community.openai.com/t/chaosgpt-an-ai-that-seeks-to-destroy-humanity/160028 https://community.openai.com/t/chaosgpt-an-ai-that-seeks-to-...