3 ms·
Stupid question... with todays memory capacities....At what limit/size do we stop using matrix-ops and simply use lookup tables todo 'matrix-math' ?
by rawoke083600 5y ago
Stupid question... with todays memory capacities....At what limit/size do we stop using matrix-ops and simply use lookup tables todo 'matrix-math' ?
- jeffbee 5y agoNot a stupid question. Economically, memory density will hit a brick wall soon. Developers should prefer to waste time and save space, since parallel computation will not hit a similar limit in the foreseeable future. Memory-to-core ratio is going to be falling.
- adgjlsfhk1 5y agoTLDR is you can't. For a very simple example, storing the products of all 3x3 matrices * length 3 vectors in Float16 precision would take 2^193 bytes (which is obviously impractical).