3 ms·
Yes, read that. What these people are talking about seems to replacing training of NNs by something else entirely. The big question is, does that work? At all?
by Animats 5mo ago
Yes, read that. What these people are talking about seems to replacing training of NNs by something else entirely. The big question is, does that work? At all?
It's premature to discuss network architecture until that basic question is answered.
- fc417fc802 5mo agoI'm maybe 10% of the way in but I find I'm increasingly skeptical. If the basic building block dates back to the 1970s haven't other people tried this by now? If not, isn't the first order of business to throw together a prototype that solves MINST or one of the many other small datasets floating around out there as a proof of concept? So unfortunately I'm inclined to assume this is empty conjecture shat out by an LLM. Because who would write something up in this much detail rather than typing `import numpy as ...` and going to town? I'll also note that the document has all the usual crank signs. Lots of grand visions, hypotheses, and expounding at an overly high level on how various things work with hardly anything concrete.