2 ms·
Super computers and data centers are two different things with markedly different requirements. Also, deep learning isn't a great fit for FPGAs anyway. There'
by monocasa 7y ago
Super computers and data centers are two different things with markedly different requirements.
Also, deep learning isn't a great fit for FPGAs anyway. There's dedicated silicon that does a better job if you're looking for matrix multiplies per watt.
Additionally, high frequency trading isn't doing much in the way of matrix multiplies, as they don't have enough time. They've got few hundred clock cycles per packet in to get a reply out.
- dragontamer 7y agohttps://www.xilinx.com/support/documentation/white_papers/wp504-accel-dnns.pdf https://www.xilinx.com/support/documentation/white_papers/wp... Xilinx absolutely markets these Alveo U200 FPGAs as deep-learning accelerators. > Additionally, high frequency trading isn't doing much in the way of matrix multiplies, as they don't have enough time. They've got few hundred clock cycles per packet in to get a reply out. I'm not a HFT-user, but I've always assumed that simulating Monte-carlo Black Scholes was roughly what HFT-traders were doing. Maybe not Black-scholes itself, but maybe some other differential equation that requires a lot of Monte-carlo runs of. Either way, Black-scholes (and other models) are partial differential equations, which are best simulated as a sequence of matrix multiplications. That's my understanding anyway.
- monocasa 7y agoThey're marketing towards that, but I can't think of any serious deep learning shops that are using them. Modern GPUs have them beat, to say nothing of dedicated ASICs. The one niche they might have I could see would be infernce on Zync-likes for non power constrained applications, but that's quite a tiny niche. And there's cute tricks to avoid matrix multiplies in the critical path for HFT.