3 ms·
There are something like three dozen startups working on different chips that can speed up this whole process. The big question for all of these companies and t
by SemiTom 8y ago
There are something like three dozen startups working on different chips that can speed up this whole process. The big question for all of these companies and their architectures is how flexible they will be for anything beyond a very specific implementation of an algorithm. This is particularly important in the AI/ML world because the algorithms are changing so rapidly. The challenge here goes well beyond the chip architecture. So if you think about the benchmarks for CPUs today, those can be blazing fast, but when you try them out on real applications they run a lot slower. Those differences may be magnified with parallel approaches. Different applications utilize different levels of parallelism with uneven performance improvements. It's not just how the processing is parsed, but also how effectively the results can be recombined after processing.
- cbHXBY1D 8y agoWell, that's why Facebook, Microsoft, and Amazon are collaborating together to create ONNX, an open source graph model. It's currently looking like ONNX will be the "LLVM IR" of the deep learning world.