4 ms·
The main concern mentioned in the comments seems to be that programmers will find it hard to work with this hardware. But is that really the intention? Wouldn'
by TekMol 4y ago
The main concern mentioned in the comments seems to be that programmers will find it hard to work with this hardware.
But is that really the intention? Wouldn't it be enough if there is one program written for it, one that takes a bunch of inputs and a bunch of outputs and then creates a set of NN weights that perform well?
So the AWS style offer would not be "rent our hardware and program on it" but "rent our hardware/software stack, throw your input/output pairs at it and get back a set (billions) of NN weights that perform well".
- WithinReason 4y agoBut then why have e.g. a branch predictor instead of making it more specialised?
- amelius 4y agoPerhaps because they will still run multiple programs, just not at the same time. Or because the program behaves differently in different places, and it is too big to optimize.