3 ms·
There isn't. The title is totally clickbait. Anything "brain-like" that fits into one single paper is bullshit.
by jimbo808 1y ago
There isn't. The title is totally clickbait.
Anything "brain-like" that fits into one single paper is bullshit.
- ljlolel 1y agoA real scientist wouldn’t use an imprecise term like “brain-like”
- dxtrous 1y agoYou can, of course, use the almost equivalent scientific-sounding Latin-derived term ("neuromorphic"), buy popcorn, and come back with it for a discussion about memristors.
- astroflection 1y agoThe actual paper's title: "The Dragon Hatchling: The Missing Link between the Transformer and Models of the Brain" Don't berate the authors for the HN submitter's carelessness.
- jimbo808 1y agoThe actual title is just as click baity
- nickpsecurity 1y agoThat last line isn't true. To be brain-like, it only needs to imitate one thing in the brain. That thing is udually tested in isolation against observed results in human brains. Then, people will combine multiple, brain-inspired components in various ways. That's standard in computational neuroscience. Our standard should simply be whether they are imitating an actual structure or technique in the brain. They usually mention that one. If they don't, it's probably a nonsense comparison to get more views or funding.
- jimbo808 1y agoI am genuinely baffled by this reply. Every single sentence you've typed is complete and utter nonsense. I'm going to bookmark this as a great example of the Dunning-Kruger effect in the wild. Just to illustrate the absurdity of your point: I could claim, using your standard, that a fresh pile of cow dung is brain-like because it imitates the warmth and moistness of a brain.
- nickpsecurity 1y agoI'll ignore the insults and rhetoric to give some examples. The brain-inspired papers have done realistic models of specific neurons, spiking, Hebbian learning, learning rates tied to neuron measurements, matched firing patterns, done temporal synchronization, hippocampus-like memory, and prediction-based synthesis for self-training. Brain-like or brain-inspired appears to mean using techniques similar to the brain. They study the brain, develop models that match its machinery, implement them, and compare observed outputs of both. That, which is computational neuroscience, deserves to be called brain-like since it duplicates hypothesized, brain techniques with brain-like results. Others take the principles or behavior of the above, figure out practical designs, and implement them. They have some attributes of the brain-like models or similar behavior but don't duplicate it. They could be called brain-inspired but we need to be careful. Folks could game the label by making things that have nothing to do with brain-like models or went very far away. I prefer the be specific about what is brain-like or brain-inspired. Otherwise, just mention the technique (eg spiking NN) to let us focus on what's actually being done.
- dang 1y ago(Submitted title was "A Brain-like LLM to replace Transformers" - a mod changed it later, in keeping with the title rule at https://news.ycombinator.com/newsguidelines.html https://news.ycombinator.com/newsguidelines.html)