5 ms·
They seem to be losing faith in themselves. I thought intel, after a decade of market domination, was sitting on piles of options and brains. But AMD made them
by agumonkey 8y ago
They seem to be losing faith in themselves. I thought intel, after a decade of market domination, was sitting on piles of options and brains. But AMD made them drown (on the PR side) way faster than I expected. The only thing they had was Premium 10cores models. No innovative design or idea.
I don't know if they sunk all their energy in the new fabs or not ..
- dingo_bat 8y ago> No innovative design or idea. Infinity fabric seems quite novel for desktops. https://en.wikichip.org/wiki/amd/infinity_fabric https://en.wikichip.org/wiki/amd/infinity_fabric
- wolfgke 8y ago> I thought intel, after a decade of market domination, was sitting on piles of options and brains. But AMD made them drown (on the PR side) way faster than I expected. The only thing they had was Premium 10cores models. No innovative design or idea. Intel has AVX-512, which is in my opinion one of the greatest innvoation in the x96 instruction set for a long time. The problem is that Intel wants to introduce AVX-512 only very slowly into consumer CPUs (slowly beginning with Cannon Lake, which will only be available in small quantities for some time if rumors are to be believed). Even more: For some parts of AVX-512 (e.g. 4FMAPS and 4FMAPS which are very useful for deep learning), Intel seems to be willing only for special expensive accelerator cards (Knights Mill) to include them to segment markets even further. Similarly it is often complained that Intel offers no ECC support for the Core i... series of CPU (IMHO this complaint is rightful). Again: Intel does offer it, but only in the much more expensive server/workstation CPUs (Xeon). So in my opinion Intel is sitting on a lot of options and brains - but they seem only willing to sell this in the really expensive CPUs for much higher prices than lots of market segments are willing to pay.
- bitL 8y agoI think they are waiting for 10nm in order to reduce massive power consumption/downclocking needed when one runs AVX-512. So in a way their manufacturing process is holding them back. AMD completely avoided these headaches by castrating AVX in Ryzen, allowing much lower TDP (65W). I am also curious why would 4FMPAS be useful for Deep Learning when all the major performance improvements lately come from half 16-bit/quarter 8-bit-precision floating/fixed point math (you don't need precise boundaries).
- wolfgke 8y ago> I am also curious why would 4FMPAS be useful for Deep Learning when all the major performance improvements lately come from half 16-bit/quarter 8-bit-precision floating/fixed point math (you don't need precise boundaries). This is a claim by Intel. See for example slide 140 of http://cs231n.stanford.edu/slides/2017/cs231n_2017_lecture15.pdf http://cs231n.stanford.edu/slides/2017/cs231n_2017_lecture15...
- hpcjoe 8y agoIntel's TPU2 and 3, as well as NVidia's V100 series get great tensor performance on FP16 and FP8. There are many implementation and algorithmic risks associated with using such small FP sizes, especially if you are working on problems related to convergence, and you have significant roundoff error. Smaller FP sizes mean you can run more of these in parallel. Smaller FP sizes mean (much) larger roundoff error, fewer bits of precision kept.
- bitL 8y agoYup, does the lower precision in Deep Learning matter though? You are basically constructing some hyper-dimensional soft boundaries separating classes of objects, and even between training runs on FP64/128/256/512 one can end up with very different boundaries - whether these come from some random training/sample order or lowered precision probably doesn't play a large role, if it speeds up training 10x? If you really want more precise boundaries, you can train on 8/16-bit first and then use transfer learning on pre-trained low-precision model with higher precision as your last step anyway.