4 ms·
You’re absolutely right, totally fair point. I was thinking about SIMD-only GPUs with many thousands of parallel threads, but yes of course, small scale SIMD is
by dahart 8y ago
You’re absolutely right, totally fair point. I was thinking about SIMD-only GPUs with many thousands of parallel threads, but yes of course, small scale SIMD is ubiquitous. Cray did a SIMD CPU before, so it has been commercially viable. I don’t know who else has done it. But don’t you think we’ll start to see mixed mode CPUs that have a lot more GPU style SIMD in them? Like, not just some vector instructions that you sprinkle into CPU code, but maybe the ability to launch a big batch of fully SIMD threads.
What I had in my head in my comment was not to suggest nobody has done it, I’m just thinking that in the future we will probably see CPU and GPU merge together. It seems like a strange byproduct of corporate chip-maker history that we currently have CPUs and GPUs that are separate things. Considering the widespread adoption of GPUs for high performance and general purpose computing, I guess I just expect to see processors become dual-mode in the future, rather than have two different single-mode chips.