4 ms·
We found a Neuron in a Neural Network Nothing new to see here. They pinpoint the nodes where the training bumped up the numbers for one token while not firing
by bfung 4y ago
We found a Neuron in a Neural Network
Nothing new to see here. They pinpoint the nodes where the training bumped up the numbers for one token while not firing other tokens.
Yes, I’m being a bit reductionist, but GPT -> transformer architecture -> neural network. We just have more detailed techniques, a lot more data, storage, and processing power now. But the basics of how a NN works hasn’t changed.
- nerdponx 4y agoThe title is a pun. The interest here is that this kind of highly-specific node activation analysis is still new in text models, unlike in image models where it's been thoroughly explored.
- sebzim4500 4y agoAre you really not surprised by this? Maybe I haven't been following the space, but I would have expected to see loads of neurons in the same layer which together determine whether [ an] or [ a] should be generated. Not one neuron which was more relevant than all the others put together.