3 ms·
Amazon shipping their own CPUs (which are only available on their cloud) and Google shipping their own TPUs (which are only available on their cloud). TPUs are
by nl 8y ago
Amazon shipping their own CPUs (which are only available on their cloud) and Google shipping their own TPUs (which are only available on their cloud).
TPUs are already a better deal than GPUs for training many models. These CPUs don't seem to have a similar niche yet, but who knows what else they have ready to switch on.
The next ten years are going to be really interesting in the hardware space.
- StillBored 8y agoWell its true about the TPU's, but you can find similar A72 based servers from other vendors if you try hard enough... https://en.wikichip.org/wiki/hisilicon/hi16xx/hi1616 https://en.wikichip.org/wiki/hisilicon/hi16xx/hi1616 The ThunderX2 based machines aren't A72's but a probably easier to source and are basically in the same conceptual ballpark.
- nl 8y agoSure, they are Arm cores, but who knows what else they have on them. Arm has a bunch of extensions[1][2] which would be really useful on these in some circumstances. And that is ignoring the "custom silicon" that Amazon claims to have. [1] https://www.arm.com/products/silicon-ip-cpu/machine-learning/arm-ml-processor https://www.arm.com/products/silicon-ip-cpu/machine-learning... [2] https://www.androidauthority.com/arm-project-trillium-842770/ https://www.androidauthority.com/arm-project-trillium-842770...