2 ms·
LLMs don't have neurons. That's just marketing lol. "A neuron in a neural network typically evaluates a sequence of tokens in one go, considering them as a who
by iraqmtpizza 2y ago
LLMs don't have neurons. That's just marketing lol.
"A neuron in a neural network typically evaluates a sequence of tokens in one go, considering them as a whole input." -- ChatGPT
You could consider an RTX 4090 to be one neuron too.
- danenania 2y agoIt’s almost as if ‘neuron’ has a different meaning in computer science than biology.
- iraqmtpizza 2y agoLOL you just owned the guy who said "LLMs with a much smaller number of neurons than the brain are in many cases producing human-level output"