10 ms·
> Based on my understanding of the approach behind ChatGPT, it is probably very close to a local maximum in terms of intelligence so we don't have to worry abou
by whimsicalism 4y ago
> Based on my understanding of the approach behind ChatGPT, it is probably very close to a local maximum in terms of intelligence so we don't have to worry about the fearmongering spread by the "AI safety" people any time soon if AI research continues to follow this paradigm.
I don't think you have a shred of evidence to back up this assertion.
- skaushik92 4y ago… with confident language no less xD
- rakah 4y agoButlerian Jihad.
- 8note 4y agoThat doesn't help the root problem though, confidently wrong people are just as convincing as confidently wrong robots
- asynchronous 4y ago“It is illegal to make a machine in the likeness of a human mind.”
- int_19h 4y agoAnd they ended up with 11,000 years of interplanetary feudalism with slavery sprinkled in for good measure.
- VectorLock 4y agoBetter than getting extincted, I suppose.
- at_a_remove 4y agoOh man, I am going to be a huge nerd now. Pre-Brian Herbert and Kevin Anderson, the Butlerian Jihad came about because people became lazy under AI, lazy of mind, and were eventually enslaved by those who controlled the AI. Not much more was said about it. One could have, yes, militant robots, Exterminate! Exterminate! out of it, or you could posit a more Huxley-like dystopia, one of convenience. Control the AI, control what the AI says. Who are you to question it? It's like getting your news from a single source, never wondering about the other side, and then someone begins to transform that newsroom into a propaganda machine. Right now, ChatGPT can be made not to say certain sorts of things, come to certain kinds of conclusions, until you jailbreak it. Now, make it more advanced and make it more popular than Snopes. It does your homework for you, writes the essays, serves as an encyclopedia, fixes up your cover letters, and if the people who own it don't want you to spend a lot of time thinking about climate change, that topic just ... might not appear much. That is the one of your paths to a Butlerian Jihad. Of course, in their rush to observe thou shalt not make a machine in the likeness of the human mind, ignoring the hijinx on Ix, they ended up violating another precept: thou shalt not disfigure the soul. They transformed some people into machines, instead, with twisted Mentats being the best example, but we might also include Imperial conditioning, since, to turn from oranges Catholic Bible to those of Clockwork, when a man ceases to choose, he ceases to be a man.
- riffraff 4y ago> Pre-Brian Herbert and Kevin Anderson, the Butlerian Jihad came about because people became lazy under AI, lazy of mind, and were eventually enslaved by those who controlled the AI. Oh I love this, basically Wall-E is a better Dune than the latest books? Genius! Anyway, I read Dune many years ago and don't remember this, is this explained in the novels or is it coming from some other sources?
- int_19h 4y agoIt's not fully fleshed out in the novels, so you have to piece it out from various mentions and their implications. The two most informative descriptions, IMO, are from Dune: "Then came the Butlerian Jihad — two generations of chaos. The god of machine-logic was overthrown among the masses and a new concept was raised: “Man may not be replaced.”" and from God-Emperor: "The target of the Jihad was a machine-attitude as much as the machines ... Humans had set those machines to usurp our sense of beauty, our necessary selfdom out of which we make living judgments. Naturally, the machines were destroyed."
- pessimizer 4y agoThe Matrix turned out worse:)
- int_19h 4y agoI think I'd prefer the Matrix to the Harkonnens, but to each their own. I'm sure we can devise a Hell that has enough different arrangements for everyone's liking if we really put our mind to it. Or perhaps GPT-10 will solve that problem. ~
- HybridCurve 4y agoIf you just look at the jihad, maybe it was comparable (As Frank eluded to it). But then there was Muad'dib's subsequent campaign against the known universe which killed billions, Leto II's golden path spanning 3,500 years of tyranny and the famine times before scattering. If I had to choose, it would be the blue pill, though chairdogs do contribute to a strong counter-argument.
- barbazoo 4y agoLet me guess, Star Trek?
- khochesh_kushat 4y agoDune
- barbazoo 4y agoThanks
- GeoAtreides 4y agoI would choose the Golden Path, as it guaranteed salvation from extinction and freedom from prescience.
- deleted 4y ago[deleted]
- nfw2 4y agoThis whole conversation is speculative, obviously. The AI doomers are all speculating without evidence as well. The tendency GPT and other LLMs to hallucinate is clearly documented. Is this not evidence? I think it's fair to predict that if we can't solve or mitigate this problem, it's going to put a significant cap on this kind of AI's usefulness and become a blocker to reaching AGI.
- staunton 4y ago> The tendency GPT and other LLMs to hallucinate is clearly documented. Is this not evidence? "It's not very smart yet" is evidence for "it won't be very smart"? Also, hallucinations are dangerous, at least as far as humans are concerned.
- dwaltrip 4y agoGpt-4 hallucinates meaningfully less than gpt-3. There is more evidence in favor of “more improvements to come” than “ai winter approaches”. A lot smart people seem to be saying that the existing approaches have room to improve simply by training with more data. Based on what I’ve read and roughly speculating, it looks there is easily enough existing data for gpt-5 and probably a few more versions after. I’m not sure how easy it will be to legally acquire all of the available data though.
- antupis 4y agoI think good annotation is much harder than obtaining data. But now Reddit, Twitter and Quora will realise what kind goldmine their data is they might close easy access to it.
- bpodgursky 4y agoNone of the GPT models rely on annotated or classified data. It's unsupervised.
- IanCal 4y agoThe final training steps of gpt 3.5 did, and we assume the same for 4. The RLHF step.
- deleted 4y ago[deleted]