4 ms·

At this point - is this even real science? I mean for every single claim made in such papers, these claims are hard to reproduce even with the same model for a

• llamaimperative 2y ago
  > LLMs have no idea they're adopting some behavior I suspect you're right, but we absolutely do not know this. We have no idea when, why, or how consciousness emerges. We have no reason to think there's something inherently special about the atoms in an animal brain that imbues them with the capability to "produce" consciousness and that the atoms on a silicon wafer are inherently incapable of doing the same thing. > Just numbers being multiplied and token probabilities being calculated based on the distributions extracted from huge sample corpus. This is not wildly different from how brains appear to work. Sure we get a gigantic, constant, highly heterogeneous multimodal stream of data inputs from our sensory systems and we get to test theories about our world model via our own actions, but of course, AI companies are all trying to produce analogs for each of these for their models too.
  • simple_quest_9 2y ago
    LLMs don't have self-perception, egos, etc. right?
    • deleted 2y ago
      [deleted]
    • llamaimperative 2y ago
      1. They definitely have self-perception to the extent necessary to "know they're adopting a behavior" if there is something there to "do" the "knowing." They ingest their own outputs as a normal matter of operation. 2. We don't know if there's something conscious there to do the knowing 3. Ego doesn't seem necessary either to being conscious or for self-perception I suspect you're right, but we don't understand nearly enough about consciousness to be confident about any of these questions.
      • wg0 2y ago
        We don't know is the main argument. So... Can I worship an LLM and start my own religion? Because we really don't know if consciousness requires X, Y or Z let alone what a a superior all knowing almighty's consciousness consists of. To me, LLMs look so superior in some ways and maybe they are the gods now that they have manifested themselves as large blobs of floating point numbers when humanity is mature enough to receive them. We don't know.
  • zzzeek 2y ago
    we have every reason to think there's something special about consciousness since it's the one "thing" in "existence" that we all seem to agree exists, yet is 100% unobservable
    • llamaimperative 2y ago
      Well yeah, consciousness is special. That's not what I said though. I said there's no reason to think the atoms in an animal (which appear to support consciousness) are special as compared to the atoms in a silicon wafer.
      • zzzeek 2y ago
        perhaps, though I think our understanding of what "consciousness" is low enough that we can't assume "atoms working as logic gates" is really sufficient.
        • llamaimperative 2y ago
          I didn’t say we should assume it’s sufficient. I said we shouldn’t assume it’s insufficient.