3 ms·
Imagine if we didn't have dedicated hardware for say caching - every CPU instruction or bit of data has to be read from SSD every use. We'd see a 100,000x slow
by londons_explore 2y ago
Imagine if we didn't have dedicated hardware for say caching - every CPU instruction or bit of data has to be read from SSD every use.
We'd see a 100,000x slowdown I expect.
But dedicated hardware (RAM, various cache levels) solved this.
We could do the same for neural net compression if we needed to. But the question is do enough people care enough about a 2x data size reduction?
- wmf 2y agoDedicated hardware isn't magic because there's an intrinsic cost that cannot be reduced. In the case of neural nets you have to store the weights somewhere and you have to perform the multiplications.