4 ms·
No, and in fact if we rewind the clock a mere 12 months ago one of the primary arguments against AI “worriers” was “of course we wouldn’t connect it to the inte
by ethanbond 4y ago
No, and in fact if we rewind the clock a mere 12 months ago one of the primary arguments against AI “worriers” was “of course we wouldn’t connect it to the internet before it was safe!”
Other gates we blew right through include, “we wouldn’t…
1. Connect it to the internet
2. Make it available to the public
3. Let it write and execute code
4. Connect it to physical C&C systems
5. Let it have money
6. Let it replicate itself
7. ”Allow” it to lie/deceive
- ramraj07 4y agoWhere did we let it replicate?
- tough 4y agoARC Team https://arstechnica.com/information-technology/2023/03/openai-checked-to-see-whether-gpt-4-could-take-over-the-world/ https://arstechnica.com/information-technology/2023/03/opena...
- ramraj07 4y agoI missed that detail from the system card pdf. That was beyond stupid. There’s a marginal chance it’s already secretly replicated out of their environment.
- PoignardAzur 4y agoWait, the ARC team didn't do their tests in a closed network? And they had it interact with actual people? That's... well, it's probably fine given what they knew about the model capabilities, but it's a pretty crappy precedent to set for "protocol for testing whether our cutting edge AI can do large-scale damage".
- deleted 4y ago[deleted]
- ethanbond 4y agoI don't think we should assume they know about their capabilities. They seem surprised with each iteration too.
- eternalban 4y agoEnergy + matter + design => Baby AI. "CnC". "Money". "internet". AI's startup will be strictly wfh ;)
- ImHereToVote 4y agoWhat's the worst thing that could happen? Extinction of all biological life in this solar system? Please.
- kfrzcode 4y agoit's not really able to make curl requests it can just generate it
- FrojoS 4y agoWell, it seems trivial to write a program that uses GPT API and curl request to feed GPT. Or am I missing something?
- kfrzcode 4y agoleft to it's own devices I reckon it'd be a real feat to generate a GPT-based tool that takes over the world. What prompts? What's the most impressive thing? Say we had a GPT bot that built it's own social media, somehow. How did it get there? what was the initial prompt? "write to yourself via this api to figure out audience growth until you gain 100k followers then wait for further instruction, use any tool and leverage this name and credit card number if you need to pay for any tools or supplies" Idk just brainstorming really have no idea what it'll do. Will build this weekend and see what happens I guess.
- maxwell 4y agoReminded me of this scenario: https://nautil.us/the-last-invention-of-man-236814 https://nautil.us/the-last-invention-of-man-236814
- ChickeNES 4y agoThanks for sharing this! I looked for it before but couldn't remember the article name or source.
- dwohnitmok 4y agohttps://www.lesswrong.com/posts/kpPnReyBC54KESiSn/optimality-is-the-tiger-and-agents-are-its-teeth https://www.lesswrong.com/posts/kpPnReyBC54KESiSn/optimality...
- ElijahLynn 4y ago
- sdwr 4y agoLove this, couldn't be happier. Hear so much about potential risks. Take our jobs blah blah end of life on earth blah skynet etc.. What about the singularity and/or giving birth to a new form of life?
- drdeca 4y ago"disneyland without children"
- ethanbond 4y agoYeah same opinion for me w/ nuclear weapons. Pretty cool to turn a planet into a sun temporarily! /s
- VectorLock 4y agoYou've been able to do that for a while, just depends on how large scale you want to get. Been doing it since the 60s.
- ethanbond 4y agoRight, and that’s bad
- VectorLock 4y agoNobody complained to Farnsworth.