4 ms·
Well hand TPU for ML is a great example (about x1000 speed improvement for tensor computation over a CPU). BUT .... TPU is just a specialized GPU which has be
by yazr 8y ago
Well hand TPU for ML is a great example (about x1000 speed improvement for tensor computation over a CPU).
BUT ....
TPU is just a specialized GPU which has been around for 20 years? So very slow evolution of a pre-existing HW component
Deep learning has been around for 5 years and we already have 2 or 3 generation of frameworks. So very rapid revolution of DSL implemented on abstracted HW
Which is the complete opposite HW-SW advocacy ?
- yazr 8y ago(cont.) What maybe i am trying to say that a "sufficiently-clever-compiler" can probably make more progress in cache performance that waiting for a great new memory-cpu architecture to appear ?