4 ms·
Previous answers are stored in an earlier layer, nodes are densely connected so the answers can "drift" to later layers. In the simplified diagram below the ne
by armchairhacker 4y ago
Previous answers are stored in an earlier layer, nodes are densely connected so the answers can "drift" to later layers.
In the simplified diagram below the network reaches the answer in the second layer at node "X", and reports derivations of it at 2 positions (obviously there are many more nodes and its a bit more complicated, see https://en.wikipedia.org/wiki/Transformer_(machine_learning_model) https://en.wikipedia.org/wiki/Transformer_(machine_learning_... as GPT3 is a transformer neural network)
O O. O
X.' 'O.
O 'O. 'X
O 'O.
O O 'X
O O
O O O