4 ms·
There may be a neuron which fires if details have to be skipped to generate a shorter answer. Maybe it originates from reinforced learning. The later could poss
by pjio 3y ago
There may be a neuron which fires if details have to be skipped to generate a shorter answer. Maybe it originates from reinforced learning. The later could possibly be confirmed or disproven by OpenAI.
- kromem 3y agoAnthropic's recent research shows that there really isn't 1:1 mapping between neurons and behavior, as it's a larger multidimensional virtual neural network fuzzily mapped onto the actual network by clusters of neurons firing. So while the same concept (with 'cluster' in place of 'neuron'), the underpinnings are a bit different from what you were saying.
- pjio 3y agoInteresting, will have a look into it! My phrasing came from a story about the discovery of a "Sentiment Neuron" in an earlier test in 2017 at OpenAI. Makes sense to have clusters of neurons for more complex concepts.