2 ms·
Logic is just a different level of abstraction, and the current generation of AIs lack it. Think of it as trying to implement an algorithm in machine code vers
by calf 4y ago
Logic is just a different level of abstraction, and the current generation of AIs lack it.
Think of it as trying to implement an algorithm in machine code versus writing it in C++ or Haskell.
Neural networks are analogous to low-level machine code. Chomsky is saying that that's a reductive and insightful and inefficient way of doing things. Human intelligence works on a higher level of abstraction--even though at the same time our brain cells are literally low-level computational abstractions as well. The two levels coexist in humans, whereas in ChatGPT it took great lengths to produce some semblance of that linguistic structure.
Chomsky explains his argument differently but his point is that humans have access to a higher level of computational abstraction, and that is the source of efficiency (we don't need to be trained on thousands of cat pictures for this information-theoretic reason).