5 ms·

We know precisely what is inside. It is just computer code.

• stevenhuang 2y ago
  So I'll just say it: you lack the knowledge foundations for an informed opinion on this topic. We know that DNA is "just" a sequence of nucleotides, yet life emerges. How does that happen, going from the world of nonliving to the living? We don't know. There are theories, but abiogenesis remains one of the most profound mysteries of science. But at the core of these theories, it is that the process of abiogenesis is informational. Computer code is information. So from an information theoretic perspective, it's quite incoherent to say something can't happen because "computer code". As in fact information may well be the entire reason we can reason, or have the complexities of life. Consider: 1) we know LLMs are universal function approximators 2) suppose the ability to reason, and the degree of reasoning ability, is a functional process that can be represented algorithmically, and can be learned 3) then might LLMs have learned some degree of reasoning ability? If you insist 3) is impossible, you must also insist 2) is impossible. And since we really don't have a definitive answer for 2) much like we don't have one for abiogenesis, your position is not really defensible. At least not to the degree of conviction you seem to hold.
  • slashdave 2y ago
    This is just silly. You can trace precisely how an LLM produces its output. You have access to all of the weights. We know precisely how the model is trained. There is no mystery here.
    • stevenhuang 2y ago
      An empty mind is the most peaceful of all.