4 ms·
“Intelligence” implies that actual thought is happening. These language models are amazing at token prediction but it’s a mistake to believe that they’re actual
by aardvarkr 4y ago
“Intelligence” implies that actual thought is happening. These language models are amazing at token prediction but it’s a mistake to believe that they’re actually intelligent.
Give it an inane prompt to better see the difference, like "write me an essay about camels and their value in cybersecurity" which gives us the answer
"The camel is a valuable animal in the cybersecurity field due to its ability to store large amounts of data in its hump. Camels are able to cross vast distances with little water, which makes them ideal for carrying large amounts of data across networks. They are also very sturdy animals, able to withstand harsh conditions and even attacks from cyber criminals. In addition, their long eyelashes protect their eyes from sand and dust, making them perfect for working in dusty environments such as data centers."
- williamcotton 4y agoThat's a pretty funny response to a pretty funny question!
- renewiltord 4y agoI'm on your team, here, Dot. Rather playful response, like someone would write in response to a creative writing prompt. In fact, I think this is the correct way to answer that question.
- CryptoBanker 4y agoFound the AI!
- mannykannot 4y agoBecause, until now, only humans could generate language like this, there is a strong temptation to anthropomorphize and attribute intent.
- jameshart 4y agoThat looks a lot like ‘playfulness’, which would generally be considered a sign of intelligence if it were observed in, say, animals. You asked it to write an essay on a nonsensical premise so you got a nonsensical essay. If you just ask chatGPT ‘what is the value of camels in cybersecurity’ it doesn’t see that as a cue to play: > I'm not sure what you mean by "the value of camels in cybersecurity." Camels are a type of mammal that are commonly used for transportation and as a source of food and other resources in certain parts of the world. They do not have any direct connection to cybersecurity.
- aardvarkr 4y agoThat’s a very generous interpretation. It’s not designed to give “playful” responses and instead what you’re seeing is a system so eager to answer the question that it doesn’t care how wrong it is. A human answer would say camels have very little to do with data security. A Google search would show you a link to Apache Camel. ChatGPT tells you how amazing a camel’s humps are for data storage. You bring up a great point that how you ask the question changes how the system responds. An intelligent being such as yourself would see the two as asking the same thing.
- williamcotton 4y ago> That’s a very generous interpretation. Otherwise known as a "sense of humor". > A human answer would say camels have very little to do with data security. Correction, a human without a sense of humor would say that camels have very little to do with data security. Edit: If I'm getting downvotes, I might as well lean into them and make it worth my while... Otherwise known as a "sense of humor". Something that ChatGPT seems to have that you don't. Oh, snap!
- aardvarkr 4y agoCan you provide an example of ChatGPT laughing at a joke? It’s fascinating that you go to such lengths to insist that it has human characteristics that it clearly does not possess.
- williamcotton 4y agoDude...
- zardo 4y agoIt's not designed to give correct answers either. It's just designed to produce text output that's similar to the text in the training set.
- 4y ago