3 ms·

They are just a bunch of floats, and they are usually stored in a binary non-human-readable format.

by ailef 3y ago

Obscurity4340 3y ago
Ya but can it be easily rendered in such a fashion that humans could read it? Must be, like minified javascript or sumfing
- Drakim 3y ago
  Sure, but they would still just be a whole long list of floats. There wouldn't be any context based on property names to gleam out of the JSON, just a long long long long list of floats.
  - Obscurity4340 3y ago
    What is it keying that to tho? Like at some point, there's has to be some flowchart that integrates the floats/ratios whatever to certain human readable concepts/keywords?
    - Drakim 3y ago
      This is an extremely simplified explanation but basically it just multiplies the floats with each other (plus some conditional logic) and that's that, the numbers that it ends up with are translated to letters* It's surprisingly similar to how human brain neurons work, and it's not something you can translate into "hard logic". That was the old school style of doing AI and it's fallen pretty flat on it's face. Old chess AIs like Stockfish are the sort where you could examine it's logic and see how it's reasoning. These new AIs are more like a mush of mathematical operations that have been fine-tuned until the mush starts to produce viable results. That mush isn't something a human can understand by looking at it, it's just random looking numbers for miles and miles. *tokens not letters, so something like the word apple might be app + le
      - Obscurity4340 3y ago
        Is it really that granular? Wow, insane, this is getting into where "technology ends and socery beginning" teritoire
        Drakim 3y ago
        Yup. I've heard many people express similar sentiments, it's like magic. Even crazier is that you can take these mushy blends of AI and merge them together willy nilly yet get viable results with traits from both, with no regard to identifying logic or functions and how they'd interact together when merged. Just blended together in a pot and a new intelligence comes out. I've heard it affectionately been called alchemy rather than programming.
        Obscurity4340 3y ago
        So it like just does the pure unicode or...I don't want to embarass myself by further explicating unassissted llol
        Drakim 3y ago
        Well, it's just float values while it's being transformed from node to node but ultimately those floats are exchanged for tokens. Tokens as kinda like letters except certain common combinations are clumped together based on how frequently they are used in human language. So "I" and "a" are likely tokens even though they are just one letter, while hamster is most likely two tokens of "ham" and "ster". I think it's just done for efficiency, since it reduces amount of variations by a great deal not having to have a separate value for every single letter. The amount of nodes that needs to interact with the value for "dog" is a lot smaller than the amount of nodes that needs to interact with the value for "d", thus the neutral network can be a lot more effective. But those tokens are translated to unicode before it's printed out to humans as the end result.
        Obscurity4340 3y ago

They are just a bunch of floats, and they are usually stored in a binary non-human-readable format.

by ailef 3y ago

They are just a bunch of floats, and they are usually stored in a binary non-human-readable format.

Ya but can it be easily rendered in such a fashion that humans could read it? Must be, like minified javascript or sumfing

Drakim 3y ago
Sure, but they would still just be a whole long list of floats. There wouldn't be any context based on property names to gleam out of the JSON, just a long long long long list of floats.
- Obscurity4340 3y ago
  What is it keying that to tho? Like at some point, there's has to be some flowchart that integrates the floats/ratios whatever to certain human readable concepts/keywords?
  - Drakim 3y ago
    This is an extremely simplified explanation but basically it just multiplies the floats with each other (plus some conditional logic) and that's that, the numbers that it ends up with are translated to letters* It's surprisingly similar to how human brain neurons work, and it's not something you can translate into "hard logic". That was the old school style of doing AI and it's fallen pretty flat on it's face. Old chess AIs like Stockfish are the sort where you could examine it's logic and see how it's reasoning. These new AIs are more like a mush of mathematical operations that have been fine-tuned until the mush starts to produce viable results. That mush isn't something a human can understand by looking at it, it's just random looking numbers for miles and miles. *tokens not letters, so something like the word apple might be app + le
    - Obscurity4340 3y ago
      Is it really that granular? Wow, insane, this is getting into where "technology ends and socery beginning" teritoire
      - Drakim 3y ago
        Yup. I've heard many people express similar sentiments, it's like magic. Even crazier is that you can take these mushy blends of AI and merge them together willy nilly yet get viable results with traits from both, with no regard to identifying logic or functions and how they'd interact together when merged. Just blended together in a pot and a new intelligence comes out. I've heard it affectionately been called alchemy rather than programming.
        Obscurity4340 3y ago
        So it like just does the pure unicode or...I don't want to embarass myself by further explicating unassissted llol
        Drakim 3y ago
        Well, it's just float values while it's being transformed from node to node but ultimately those floats are exchanged for tokens. Tokens as kinda like letters except certain common combinations are clumped together based on how frequently they are used in human language. So "I" and "a" are likely tokens even though they are just one letter, while hamster is most likely two tokens of "ham" and "ster". I think it's just done for efficiency, since it reduces amount of variations by a great deal not having to have a separate value for every single letter. The amount of nodes that needs to interact with the value for "dog" is a lot smaller than the amount of nodes that needs to interact with the value for "d", thus the neutral network can be a lot more effective. But those tokens are translated to unicode before it's printed out to humans as the end result.
        Obscurity4340 3y ago