4 ms·

That'd be a very weak case as it rests entirely on a superficial comparison, but then since AI isn't a human and doesn't train like a human, it doesn't make muc

by eviks 3y ago

That'd be a very weak case as it rests entirely on a superficial comparison, but then since AI isn't a human and doesn't train like a human, it doesn't make much sense to equate these processes and apply the regulations made for humans wholesale

PaulHoule 3y ago
It's not superficial in the slightest. There is a cult of creativity that leads people to say things like "a neural network can never do anything creative" and instead that it just parrots back exactly what it's been told but no, it has an ability to generalize, which is why diffusion models trained to draw pornography draw girls with 7 belly buttons and you don't have to be worried that ChatGPT will tell you how to build a bomb because it will tell you how to build a hydrogen bomb using shaving cream and ski wax. When I read a book it changes connections weights between the synapses in my brain. I don't retain an exact copy but I recall the gist of the book and some facts (imperfectly) I have the ability to generalize this information (I can read The Tale of Genji and retell a story based on it that is set on a Mars Colony in 4712AD) and it can improve my linguistic abilities in general.
- eviks 3y ago
  One of the huge missing parts is meaning, and rephrasing your reading of a book into an AI "weights" language is, sorry, still very superficial since these aren't the same, just like you don't have some simple gradient descent optimization function in your brain, so you can't substantively say "oh, our brain just optimizes for something just like AI, so it's the same learning process, so same rules should apply"
  - PaulHoule 3y ago
    Even people like Jurgen Habermas don't really know what they mean when they say "meaning", it's one of the most problematic concepts in all of philosophy. Humans read stuff and think they understood the "meaning" but they really didn't. If you don't believe me, try grading a quiz. In the case of A.I. engineering a very useful form of "understanding" is a decomposition into facts. For instance if an A.I. read an article about a sports game it ought to be able to generate a database entry saying who played, where, who won, what the score is, etc. It sounds very easy but this kind of information extraction is preparadigmatic and I know because I've tried to build this kind of system. LLMs beat older system at it but that's because older systems fail at it completely. In the case of the game, for instance, simple pattern matching falls down for quite a few reason, not least that a good account of a game will probably give the same facts for the last game that team A played and the last game that team B played and also the last game A and B played, not to mention league standing information that might superficially look like the score of a game. That kind of "meaning" is explicitly allowed to be copied under copyright law, see https://libraries.emory.edu/research/copyright/copyright-data https://libraries.emory.edu/research/copyright/copyright-dat...
    - eviks 3y ago
      The fact that Jurgen doesn't know doesn't help your argument, you're the one creating the identity to apply the same laws in the same way, and if you don't know about some relevant property of human brain activity, you can't make a claim that it's identical to whatever AI is doing.

by eviks 3y ago

PaulHoule 3y ago

It's not superficial in the slightest. There is a cult of creativity that leads people to say things like "a neural network can never do anything creative" and instead that it just parrots back exactly what it's been told but no, it has an ability to generalize, which is why diffusion models trained to draw pornography draw girls with 7 belly buttons and you don't have to be worried that ChatGPT will tell you how to build a bomb because it will tell you how to build a hydrogen bomb using shaving cream and ski wax. When I read a book it changes connections weights between the synapses in my brain. I don't retain an exact copy but I recall the gist of the book and some facts (imperfectly) I have the ability to generalize this information (I can read The Tale of Genji and retell a story based on it that is set on a Mars Colony in 4712AD) and it can improve my linguistic abilities in general.

eviks 3y ago
One of the huge missing parts is meaning, and rephrasing your reading of a book into an AI "weights" language is, sorry, still very superficial since these aren't the same, just like you don't have some simple gradient descent optimization function in your brain, so you can't substantively say "oh, our brain just optimizes for something just like AI, so it's the same learning process, so same rules should apply"
- PaulHoule 3y ago
  Even people like Jurgen Habermas don't really know what they mean when they say "meaning", it's one of the most problematic concepts in all of philosophy. Humans read stuff and think they understood the "meaning" but they really didn't. If you don't believe me, try grading a quiz. In the case of A.I. engineering a very useful form of "understanding" is a decomposition into facts. For instance if an A.I. read an article about a sports game it ought to be able to generate a database entry saying who played, where, who won, what the score is, etc. It sounds very easy but this kind of information extraction is preparadigmatic and I know because I've tried to build this kind of system. LLMs beat older system at it but that's because older systems fail at it completely. In the case of the game, for instance, simple pattern matching falls down for quite a few reason, not least that a good account of a game will probably give the same facts for the last game that team A played and the last game that team B played and also the last game A and B played, not to mention league standing information that might superficially look like the score of a game. That kind of "meaning" is explicitly allowed to be copied under copyright law, see https://libraries.emory.edu/research/copyright/copyright-data https://libraries.emory.edu/research/copyright/copyright-dat...
  - eviks 3y ago
    The fact that Jurgen doesn't know doesn't help your argument, you're the one creating the identity to apply the same laws in the same way, and if you don't know about some relevant property of human brain activity, you can't make a claim that it's identical to whatever AI is doing.