3 ms·
The DPU (Data Processing Unit) which is specialist unit like the GPU but for data tasks like sorting, grouping will be a reality soon!
by xiaodai 7y ago
The DPU (Data Processing Unit) which is specialist unit like the GPU but for data tasks like sorting, grouping will be a reality soon!
- lmeyerov 7y agoIt's a tough space.. seems more economically feasible to just slightly update GPUs for it, similar to what's happening for ML/tensors/etc, and for the rest, FPGAs for prototyping => ASICs for deployment. We were originally building on OpenCL to keep this path open, but a few years later, feels the long-term mainstream + hyperscalar is more like: -- Mainstream: Updated GPUs for general ETL (see: https://rapids.ai https://rapids.ai for replacing spark/pandas/sql/flink/etc. w/ streaming GPU ETL in various convenience formats), w/ assumption of continued hw/sw co-design by Nvidia as more of the data stack than just some neural nets get subsumed -- Some experimental work on FPGAs... -- Hyperscalar / bigshops: ... FPGAs mostly for then getting ASICs for the same thing, e.g., sifive's stack, esp. as cloud vendors figure out asics-as-a-service w/ rapid tapeout & 100X more bandwidth. Still easily a few years away pragmatically tho. But if you're say Netflix and the dev cost of doing this stuff drops say ~10X and you get 1-10% cost savings... more than pays for itself. Wall St. tried GPUs years ago and gave up b/c of usability vs payoff, so FPGAs are still in the middle, yet as tool chain improves, the GPU toolchain is now ~there, and not far for ASICs.
- cma 7y agoPossibly leaked here: https://www.youtube.com/watch?v=YGTZr6bmNmk&t=18m55s https://www.youtube.com/watch?v=YGTZr6bmNmk&t=18m55s PS5 is supposed to be all about instantaneous load times and Sony has a recent patent on selectively dispatching data from storage to an FPGA instead of (or prior to) going to CPU/GPU.