3 ms·
I think spiking neural networks are still pretty interesting, because they're the only type that we have hard evidence of being able to produce general intellig
by taneq 5y ago
I think spiking neural networks are still pretty interesting, because they're the only type that we have hard evidence of being able to produce general intelligence.
I agree, though, that if they're just doing 'conventional' neural network based machine learning, it's hyperbolic to call it 'the future of deep learning'. Anything these can do, by the sounds of it, GPUs can do a bit slower.
Of course, 'quantity has a quality all of its own' and we wouldn't be doing things like GPT3 without GPUs... but then again the current approach of just throwing a bigger network at a problem seems to me to be a way to overfit your training data while pretending you're not.