5 ms·
I wonder if this could be done on a FPGA..
by sexy_panda 4y ago
I wonder if this could be done on a FPGA..
- Frost1x 4y agoWith enough gates you can do anything on an FPGA
- vasco 4y agoFPGA for development, AWS can afford to order custom ICs.
- toomuchtodo 4y agoCould surplus crypto miner GPUs be repurposed for this?
- vasco 4y agoNo
- pclmulqdq 4y agoHow much would someone pay for this? I have a half-written zstd core, but I doubt the market for $100-150 FPGA-based compression accelerators is all that large.
- tgsovlerkhgsel 4y agoProbably not worth it as a FPGA solution or even in general as an add-on card (the overhead of dealing with such extra hardware means that the threshold for "worth it" is very high). I would expect this to become part of newer generations of CPUs once it becomes popular.
- wmf 4y agoIntel sells a gzip PCIe card called QAT. Not many seem to be sold.
- NelsonMinar 4y agoI'd never heard of this! The full name is QuickAssist and it does encryption too. They advertise 100Gb/s symmetric crypto, 70Gb/s compression (or roughly 100x faster than ZStandard on a single CPU). Seems to retail for about $650 for a card.
- sexy_panda 4y agoIt seems like QuickAssist can also be used for Transcoding. Plex e.g. supports it. My Intel i9 11900k seems to support it or has it built-in.
- pclmulqdq 4y agoQAT is actually likely to end up inside new server CPUs from Intel - at least according to the advertising material. Also, it is in their new SmartNICs. At least somebody is using it.
- zxcvbn4038 4y agoIt has been done before, if you offload gzip you turn your PCI bus into a choke point. Most of the time you do better keeping it on the main processor.