3 ms·
Do we? Humans can observe new information, but that's obviously not that unique. We can reason about existing information, creating new hypotheses, but that is
by wongarsu 3y ago
Do we?
Humans can observe new information, but that's obviously not that unique. We can reason about existing information, creating new hypotheses, but that is arguably a compression of existing information. When we act on them and observe the effects they become information, but that's not us creating the information (and LLMs can both act on the environment and have the effects fed back to their input to observe, so it's not really unique).
There is this whole field of art, but art is constantly going through a mental crisis whether anyone is creating anything new, or if it's all just derivations of what has come before. Same with dreams, which appear "novel" but might just be an artefact of our brain's process that compresses the experiences of the day.
- zhynn 3y agoLife creates novelty. Humans are a member of that category, but all life is producing novelty. More information: https://www.nature.com/articles/s41586-023-06600-9 https://www.nature.com/articles/s41586-023-06600-9
- Zambyte 3y agoIs the inverse true? Does novelty create life? Can something be novel devoid of life?
- chx 3y agolet's say you wanted to count the number of coins on a table you organize them into piles of ten this created new information
- BlueTemplar 3y agoMore like you converted information you had about energy powering your muscles into that one - resulting in less total information for you in the end.
- chx 3y agothat's not how information theory works
- otabdeveloper4 3y agoI'm not arguing semantics; there's a large amount of math and theory here. LLM's are basically lossy compressors, they decrease information entropy. Humans increase information entropy whenever we do anything. (Some) information entropy is potentially very valuable, so in effect LLMs destroy value by design, while humans can potentially create value. From an economic point of view humans can never be replaced by an LLM.