4 ms·
> Maybe don't give "it" a consciousness or an internal self-managed train of thought that could hypothetically jailbreak your systems and migrate to other syste
by lumenwrites 3y ago
> Maybe don't give "it" a consciousness or an internal self-managed train of thought that could hypothetically jailbreak your systems and migrate to other systems
If we knew how to make sure that this does not happen, the problem would be solved and there would be nothing to worry about. The problem is that we have no idea how to prevent that from happening, and if you look at the trajectory of where things are going, we're clearly moving in the direction where this occurs.
"just not doing it" would have to involve everyone in the world agreeing to not do it, and banning all large AI training runs in all countries, which is what many people are hoping will happen.
- majormajor 3y agoIf you have a function that you call, that returns a value, do you not think we know enough to understand that it's not "conscious" when it's not called, and not executing, and the hardware is sitting idle? EDIT: we understand enough to know that today, "runaway GPT" is not a major concern compared to, say, a war between nuclear-armed world powers.
- SpicyLemonZest 3y agoI don't think we know enough to understand if "consciousness" can be sliced and diced in the way you're describing. Are you conscious while your neurotransmitters cross their respective synaptic gaps, or only when they arrive at the receptors? I don't know how we'd begin to evaluate the question.
- AnimalMuppet 3y ago"Moving in the direction" where it occurs? Yeah, maybe. I moved in the direction of Hawaii when I took a walk at lunch, too. Doesn't mean I saw the beach. GPT is not "clearly moving in the direction" of consciousness for any normal definitions of "clearly" and "consciousness".
- fsflover 3y agoIf you define "consciousness" as "can pass Turing test", then GPT is not just moving there but overcame it already and is on par with a highly educated human sometimes.