Keep in mind that many of the GPU cores go unused, since they are dedicated to geometry or ray tracing or whatnot: https://www.pcworld.com/article/402592/nvidi

Keep in mind that many of the GPU cores go unused, since they are dedicated to geometry or ray tracing or whatnot: https://www.pcworld.com/article/402592/nvidia-turing-gpu-geforce-rtx-2080-ti.html https://www.pcworld.com/article/402592/nvidia-turing-gpu-gef... IMHO these chips designed for specialized workloads are looking more and more ridiculous. I expect GPU manufacturers to keep dragging them out for another decade or so, as well as Apple as it explores offshoots of M1. It all makes me feel very tired (the ultimate code smell). A better design would be something like a 256+ core RISC-V with local memories in/by each core for data-locality and a content-addressable caching scheme for deduplication. Copy-on-write languages like Clojure and orchestrating processes under something like Docker would make it a breeze to program, although it would still support manually managed mutability like with Rust for innermost loops in games or whatever. It's fairly obvious how it would all work, but IP law and gatekeeping ensure that it will not happen anytime soon. Then stuff like CUDA would be just another framework run on a symmetric multiprocessor and we could get back to exploring alternatives like genetic algorithms like we did in the 1990s. Thankfully nobody cares what I think, heck even I'm sick of reading my own complaints, so it's easy enough to just unsee this.