NumberWangMan

17 ms·

91.
by NumberWangMan 3y ago
I'm what you'd call a doomer. Ok, so if it is possible for machines to host general intelligence, my question is, what scenario are you imagining where that ends well for people? Or are you predicting that machines will just ne
92.
by NumberWangMan 3y ago
I mean, just like you can create 1-line python script that claims "I am an AGI" and have that fact be false, you can have ChatGPT tell you it has no explicit world model, while exhibiting behaviors that can only really be explaine
93.
by NumberWangMan 3y ago
You sound skeptical of regulation. I think being skeptical of regulation may be a heuristic that almost always works. (1) I won't argue that the incentives for regulators aren't really messed up. But I argue that AI is different
94.
by NumberWangMan 3y ago
I hope you're right. I worry that we'll get it done, though. I hope it turns out that energy requirements and the difficulty in scaling are enough that it gives us time to figure out how to align them properly. One big question
95.
by NumberWangMan 3y ago
Ok, please don't accuse those you disagree with of arguing in bad faith. Maybe a few do, but I think most don't, and it's not good for productive discussion. I honesty believe that people who argue against worrying about AGI
96.
by NumberWangMan 3y ago
My worry is that as we start wiring non-super-intelligent AI more into our society, we'll make ourselves more and more vulnerable in the case where an AGI actually gets out of control. Pulling the plug on AI may mean causing a lot of
97.
by NumberWangMan 3y ago
I mean, speaking as someone who's really worried about speed of AI research... that's good news to me.
98.
by NumberWangMan 3y ago
Hey, I was just this idea the other day. One can imagine a world in which all new tech has to go through a period of deliberation before it ever sees the light of day. There would clearly be a lot of things that would be blocked. Some of
99.
by NumberWangMan 3y ago
Well, hold on -- the selfish gene is not hardwired to self-multiply either. It's just that the ones that do self multiply stick around more. Likewise, one can imagine the evolution of AI's being bootstrapped, not by self-multiply
100.
by NumberWangMan 3y ago
Pair programming has upsides and downsides of course, but one big upside in this particular case is that onboarding goes a lot faster and there's no chance of someone working multiple jobs, or slacking.
101.
“Just a statistical text predictor”(asanai.net)
45 points by NumberWangMan 3y ago|87 comments
102.
by NumberWangMan 3y ago
Most of the environmentalists I hang out with are on board with most of those ideas, myself included. (And also carbon taxation, which incentivizes a bunch of them) Geo-engineering is a tough one, and I think should be viewed as a last re
103.
by NumberWangMan 3y ago
If you get electricity from the sun (or the wind, which is essentially sun power), then you are heating the earth no more than it would be heated by the sunlight anyway. You're just intercepting the sunlight power and using it to do s
104.
by NumberWangMan 3y ago
I would be ok with a general replacement of humanity by AI, assuming they have their own versions of good things like art and love. Maybe even if not. But invasive species replace native ones on a very fast timescale, evolutionarily speaki
105.
by NumberWangMan 3y ago
I'm not really convinced by "argument from human works of fiction". More aggressive, more violent species end up replacing more gentle ones all the time.
106.
by NumberWangMan 3y ago
To call the problems around the creation of AGI "bike shedding" is one of the most egregious understatements I've ever heard. AGI will be one of the most civilization-changing inventions ever, for better or for worse. A lot
107.
by NumberWangMan 3y ago
> Will the artificial agents replace the human species? One can certainly hope so. First, not so great of a species, as mentioned. Secondly, the universe is large and the humans are squishy, something else must go on eventually. Easy eno
108.
by NumberWangMan 3y ago
So it is with any technological innovation. Should computers not have been invented because they eliminated jobs? Should steel? What about agriculture? The future is sure to be different, but that doesn't mean we should fight to deny p
109.
by NumberWangMan 3y ago
A list of genocidal dictators: https://www.scaruffi.com/politics/dictat.html Anyone who comes into power enough to do something like this has a high amount of intelligence -- not necessarily book smarts, but the abilit
110.
by NumberWangMan 3y ago
Why do you need to prove no correlation? Even if there's a correlation, unless that correlation is extremely strict, there is some risk of a super-intelligence turning nasty. And a strict correlation is simple to disprove with, say
111.
by NumberWangMan 3y ago
orthogonality is almost perfectly wrong; ethics&planning ability is highly correlated with intelligence I'm guessing you're a very nice person. There have been a lot of smart people in history who gained power and did very, v
112.
by NumberWangMan 3y ago
Good point. I'm partially conflating the definition I usually mean, which is "having a goal in the world", with what they're doing, which is "having ability to affect the world". Hugging Face is trying to kee
113.
by NumberWangMan 3y ago
That's all stuff that LLMs are really, really good at handling though. All you need is prompts that explain what's on the menu, all the ingredients, allergy info, calorie counts, etc. and it will be able to handle it. And I&#x27
114.
by NumberWangMan 3y ago
I'm not 100% sure that AGI is guaranteed to end humanity like Yudkowsky, but if that's the course we're on, seeing news like this is depressing. Can anyone legitimately argue that LLMs are safe because they don't have a
115.
by NumberWangMan 3y ago
And even with all that, probably it's best to still exercise an abundance of caution, because you might have made a mistake somewhere.
116.
by NumberWangMan 3y ago
Elon Musk is part of a big framework we've created to stop things going off the rails. It's got humans in the loop at pretty much every step, and sometimes still goes wrong, for example, working conditions in amazon fulfillment c
117.
by NumberWangMan 3y ago
Still potentially way easier said than done. Robert Miles has a good video on this. One issue is that to define something like "harm", you need to solve a whole bunch of philosophy problems. And people disagree -- does corpora
118.
by NumberWangMan 3y ago
Really neat! A clever idea, and it's good to see this kind of work being done. Also, does the second image in the article change when you click to open it, for anyone else? The normal preview in the page shows as a duplicate of the f
119.
by NumberWangMan 3y ago
Thanks, that's a great breakdown of other considerations!
120.
by NumberWangMan 3y ago
> Let’s say you became “comically” smarter overnight, could you really significantly benefit that extra knowledge? Besides going for the Millenium Prize problems, the benefits would not be too significant, for example is it that valuable

More ›