3 ms·

> But you don't do that by computing relative word frequencies in the content a That's a lot of assumptions about human level intelligence. We do know that the

> But you don't do that by computing relative word frequencies in the content a That's a lot of assumptions about human level intelligence. We do know that the more you read, the better you can write, and a lot of our text is "inspired" by words and styles that we read in the past. You claim this isn't an algorithm, I don't think we really know how human intelligence works. > You don't get words from what you read and study, you get ideas, and ideas can't be copyrighted. That's completely oblivious to how humans actually read and study, of course you get words, if you are lucky you might also get ideas, but at least you get words (assuming ideas aren't words to begin with). The government is eventually going to have to make a decision on this one way or the other, or we will just cede the whole of advancement to China (who won't bother with this debate and just do what works the best).

pdonis 2y ago
> That's a lot of assumptions about human level intelligence. I disagree, but I doubt we're going to get anywhere by discussing it. It seems to me that you are either seriously undervaluing human intelligence, or seriously overvaluing LLMs.
- seanmcdirmid 2y ago
  I just know that we don’t actually know. We assume we are special, but we could just be stringing words together based on what we experienced and learned with what we remember for prompting.
  - pdonis 2y ago
    There's a lot we don't know about the details of how our brains work, but we do know that our brains are connected to the external world in a huge number of ways that LLMs are not. The only connections to the external world that LLMs have are their training data and the prompts they are given. That is an incredibly paltry level of connection compared with the connections that our brains have. Those connections make a huge difference. As AI technology evolves, I would expect that the connections AIs have with the external world will become much more extensive, and that will make a huge difference as well. But current LLMs simply don't have that, and it shows.
dse1982 2y ago
It is absurd to act as if machines would do the same as human brains if you don’t even know what human brains do.

pdonis 2y ago

> That's a lot of assumptions about human level intelligence. I disagree, but I doubt we're going to get anywhere by discussing it. It seems to me that you are either seriously undervaluing human intelligence, or seriously overvaluing LLMs.

seanmcdirmid 2y ago
I just know that we don’t actually know. We assume we are special, but we could just be stringing words together based on what we experienced and learned with what we remember for prompting.
- pdonis 2y ago
  There's a lot we don't know about the details of how our brains work, but we do know that our brains are connected to the external world in a huge number of ways that LLMs are not. The only connections to the external world that LLMs have are their training data and the prompts they are given. That is an incredibly paltry level of connection compared with the connections that our brains have. Those connections make a huge difference. As AI technology evolves, I would expect that the connections AIs have with the external world will become much more extensive, and that will make a huge difference as well. But current LLMs simply don't have that, and it shows.

dse1982 2y ago

It is absurd to act as if machines would do the same as human brains if you don’t even know what human brains do.