4 ms·
This is an extremely simplified explanation but basically it just multiplies the floats with each other (plus some conditional logic) and that's that, the numbe
by Drakim 3y ago
This is an extremely simplified explanation but basically it just multiplies the floats with each other (plus some conditional logic) and that's that, the numbers that it ends up with are translated to letters*
It's surprisingly similar to how human brain neurons work, and it's not something you can translate into "hard logic". That was the old school style of doing AI and it's fallen pretty flat on it's face. Old chess AIs like Stockfish are the sort where you could examine it's logic and see how it's reasoning. These new AIs are more like a mush of mathematical operations that have been fine-tuned until the mush starts to produce viable results. That mush isn't something a human can understand by looking at it, it's just random looking numbers for miles and miles.
*tokens not letters, so something like the word apple might be app + le
- Obscurity4340 3y agoIs it really that granular? Wow, insane, this is getting into where "technology ends and socery beginning" teritoire
- Drakim 3y agoYup. I've heard many people express similar sentiments, it's like magic. Even crazier is that you can take these mushy blends of AI and merge them together willy nilly yet get viable results with traits from both, with no regard to identifying logic or functions and how they'd interact together when merged. Just blended together in a pot and a new intelligence comes out. I've heard it affectionately been called alchemy rather than programming.
- Obscurity4340 3y agoSo it like just does the pure unicode or...I don't want to embarass myself by further explicating unassissted llol
- Drakim 3y agoWell, it's just float values while it's being transformed from node to node but ultimately those floats are exchanged for tokens. Tokens as kinda like letters except certain common combinations are clumped together based on how frequently they are used in human language. So "I" and "a" are likely tokens even though they are just one letter, while hamster is most likely two tokens of "ham" and "ster". I think it's just done for efficiency, since it reduces amount of variations by a great deal not having to have a separate value for every single letter. The amount of nodes that needs to interact with the value for "dog" is a lot smaller than the amount of nodes that needs to interact with the value for "d", thus the neutral network can be a lot more effective. But those tokens are translated to unicode before it's printed out to humans as the end result.
- Obscurity4340 3y agoWho DISCOVERED discovered this approach?
- Drakim 3y agoNo idea, you'll have to google up the history, but this approach has been toyed around with for ages. Neutral networks are absolutely not new, you can find tons of youtubes of people making small creatures that use neural networks to find food in a simulated environment. The revolution, from what I understand, comes from new techniques to very quickly grade good/bad behavior so you don't need a human to mark every result as good or bad as it's being trained.