2 ms·
There is a showstopper: Running a neural algo using already formed net is easy-peasy. Doing actual learning on an MCU for anything serious is still impossible.
by baybal2 8y ago
There is a showstopper:
Running a neural algo using already formed net is easy-peasy. Doing actual learning on an MCU for anything serious is still impossible.
Learning can be ran on commodity GPUs/DSPs, and they will not be that much worse than dedicated hardware. But on embedded side, a small, low-power ASIC is the only thing that makes makes 99% voice recognition a possibility.
This is why I think that learning startups will not go anywhere far in comparisons to companies that will be using results of that learning that can be done in DCs using commodity hardware.
- rbanffy 8y agoYou can give the illusion of edge-learning by shipping datasets to large number-crunchers in the cloud and receiving altered nets from it. That even gives one the benefit of learning from the collective experience of fellow devices. I wonder if we could (of course we can, I'm wondering if someone already did it) split the training workload across a number of small embedded devices with their tiny NEON units and have them share the resulting trained models. Making nodes self-coordinate the shared workload and assemble the results would be interesting.