4 ms·
> But it's not true today, because today hand-tuned assembly is slow compared to what you can do on the GPU or an FPGA or a TPU. That's not how thing work. GPU
by littlestymaar 8y ago
> But it's not true today, because today hand-tuned assembly is slow compared to what you can do on the GPU or an FPGA or a TPU.
That's not how thing work. GPUs/TPUs aren't magic, they don't speed everything up: they are really good is some scenario, but they are really slow in many others: the cost of loading memory to the GPU and back from it has a huge cost and it's only worth it if the GPU has enough work to do with the workload.
In theory, you could write a web server that runs on the GPU (at least a majority of it, it will still need some CPU work obviously), but it would be incredibly slow, probably slower than if it was a regular web server running on a machine from the 90s.
FPGA are totally different beasts, you can theoretically speed up anything with them, but
1. that requires a LOT of work, and
2. they aren't new: anything you can do with FPGA today, you could do it in 1995 already.