Well, it's just float values while it's being transformed from node to node but ultimately those floats are exchanged for tokens. Tokens as kinda like letters e

Well, it's just float values while it's being transformed from node to node but ultimately those floats are exchanged for tokens. Tokens as kinda like letters except certain common combinations are clumped together based on how frequently they are used in human language. So "I" and "a" are likely tokens even though they are just one letter, while hamster is most likely two tokens of "ham" and "ster". I think it's just done for efficiency, since it reduces amount of variations by a great deal not having to have a separate value for every single letter. The amount of nodes that needs to interact with the value for "dog" is a lot smaller than the amount of nodes that needs to interact with the value for "d", thus the neutral network can be a lot more effective. But those tokens are translated to unicode before it's printed out to humans as the end result.