4 ms·
Author here. I didn't write the follow-up yet because it requires a lot of research and I'm busy :-) If you ask me, GPUs are anything but "the new FPGA". GPUs
by _yosefk 12y ago
Author here.
I didn't write the follow-up yet because it requires a lot of research and I'm busy :-)
If you ask me, GPUs are anything but "the new FPGA". GPUs are the least efficient hardware accelerator out there, but also the most accessible to the largest number of programmers. FPGAs are much more efficient than GPUs on DSP workloads and GPUs are useless for I/O while FPGAs are a godsend. On the other hand, FPGAs have a ton of problems GPUs don't have. The two do not look similar to someone caring about accelerators any more than snow and ice look similar to someone living at a place where they get to see both... though the two might seem similar to people from hot places where neither is common (or perhaps if they saw one but never the other.)
- solve 12y agoBut are they the most efficient in cost-per-computation? For all the major data crunchers I'm familiar with, doing either finance or scientific calculations, that's the only metric they cared about. Only place I can see the cost-per-computation metric not mattering is in space satellites. Am I way off?
- skaevola 12y agoFor any sort of mobile device energy-usage per computation is an important metric. Hence you have chips with multiple low power modes which can trade off different amounts of computational power with different amounts of power efficiency.
- solve 12y agoBut ASIC is 100x better than FPGA for energy per computation. Know of any mobile devices that have FPGAs on them now?
- _yosefk 12y agoIt's not fair to compare a programmable circuit with a fixed-function circuit though, because programmability is often a requirement.
- skaevola 12y agoSure: http://www.eejournal.com/archives/articles/20131118-lattice/ http://www.eejournal.com/archives/articles/20131118-lattice/ But you're right - when programmability isn't important you'd rather have an ASIC.
- _yosefk 12y agoDo you get more throughput per dollar with FPGA relative to GPUs? Most certainly, except for floating point stuff, especially double precision. (Finance would care much less than scientific computing and I think FPGAs are way more prominent there.)
- solve 12y agoYou sure? The ones I'm personally familiar with are investment banks that have hundreds of thousands of computers doing machine learning modeling. They ran the costs, and found GPUs to be far more cost effective.
- _yosefk 12y agoMachine learning software will tend to use floating point, hence the result IMO. In HFT for instance I'd expect things to be the opposite.