2 ms·
I totally agree with this. I've long dreamed of something like a FPGA for NN's where the gradient is built into the hardware configuration. Someday I'll sit d
by Enginerrrd 6y ago
I totally agree with this. I've long dreamed of something like a FPGA for NN's where the gradient is built into the hardware configuration.
Someday I'll sit down and actually try to design a prototype for such a thing.
- nshdesai 6y agoIt's also worth mentioning that the hardware is not the only thing that should change. Cognition seems hard to automate just using instructional directives for producing the states of such a machine. Encoding the gradient right into the hardware would be cool, but the optimization procedure should also move to being something intrinsic to the machine.