3 ms·
I think that's the big advantage of FPGA. If you need acceleration to hit a 10 microsecond latency target, FPGA is what you need. If your latency target is li
by daxfohl 6y ago
I think that's the big advantage of FPGA. If you need acceleration to hit a 10 microsecond latency target, FPGA is what you need. If your latency target is like a millisecond or longer, then GPU can handle a lot more throughput. But GPU can't typically give you a 10-us guarantee.
Okay, bit-banging is another advantage of FPGA that GPU doesn't do as well. There are a few things.
- inaccel 6y agoRegarding DNN inference FPGA can provide low latency AND higher throughput than GPUS. If you want to compare apples-to-apples, we have done a comparison with realistic (and not synthetic) data regarding the performance of GPUs and FPGAs. https://medium.com/@inaccel/faster-inference-real-benchmarks-on-gpus-and-fpgas-fa3df04d51d7 https://medium.com/@inaccel/faster-inference-real-benchmarks...
- daxfohl 6y agoUgh, ad spam taking over HN.