3 ms·
Software will lag new hardware. Duh. The question is whether this is solvable (given a couple of master devs) Cerebras itself commented that DL is not their fi
by algo_trader 6y ago
Software will lag new hardware. Duh. The question is whether this is solvable (given a couple of master devs)
Cerebras itself commented that DL is not their first use case. They mentioned fluid dynamics instead. (I can find the reference if someone is interested).
Cerebras also has a weird memory/compute ratio, so very hard for some uses.
Somewhat off-topic. If u have standard keras/TF training code, the GPU to TPU is a smooth-ish transition. No?
A re-write will squeeze another 20% but not 200%?