3 ms·
Someone should just build an ANN as big as currently as possible with current hardware, while still having both inference and training to be as close to real-ti
by drillsteps5 9mo ago
Someone should just build an ANN as big as currently as possible with current hardware, while still having both inference and training to be as close to real-time as possible (micro-to milli-seconds), build the self-learning using some loose equivalents of pain/pleasure feedback in actual brains, plug sensors and actuators from some sort of robot, and just see what happens.
I think anything less than that is just a parlor trick.
- htrp 9mo agoTaking the biological approach to 11 there?
- drillsteps5 9mo agoANN is an attempted model/ripoff (turned out to be extremely simplified but still) of a brain, why not go further? Continuous autonomous learning (which requires continuous feedback in a way of good/bad stimuli) is clearly what makes it work. The current approach of guided pre-training and inference on essentially a "dead brain" clearly causes limitations.
- fyredge 9mo agoThat's still not enough. The biggest architectural hurdle to actualised artificial intelligence is the feed forward model. Unlike AI, all animals take in various inputs and produce various outputs asynchronously. That means the feed forward model of all NNs are fundamentally limited. Even recurrent NNs can't overcome this since they need a new input every iteration.
- drillsteps5 9mo agoMakes sense. The counterpoint would be that when they started to build LLMs they must have clearly seen limitations of the approach and proceeded regardless, and achieved quite a bit. So the approach to introduce continuous (in-vivo if you will) self-guided training AND multiple sensors and actuators would still be limited but might yield some interesting results nevertheless.