4 ms·
While FPGA may prove more efficient than 3090, a primarily gaming card, I can’t see how it should be more efficient than dedicated training/inference card, as t
by cherioo 2y ago
While FPGA may prove more efficient than 3090, a primarily gaming card, I can’t see how it should be more efficient than dedicated training/inference card, as the latter are more effectively ASIC, not to mention memory and bandwidth limitations.
Is there something I am missing making FPGA potentially more viable, besides not feeding into NVIDIA’s greed?
- KeplerBoy 2y agoA dedicated training/inference card is still more general than an LLama 2 inference card. It's obvious that you will get better efficiency the more you tailor your silicon to the task, with diminishing gains but still.