32 ms·
GPUs are no longer GPUs... ai accelerators (AIA) is a better term. My MI300x don't have display ports. ;-) I actually see a lot of parallels to bitcoin mining.
by latchkey 3y ago
GPUs are no longer GPUs... ai accelerators (AIA) is a better term. My MI300x don't have display ports. ;-)
I actually see a lot of parallels to bitcoin mining. It started on cpus, then gpus, then fpgas and soon after asics. We are starting to see something similar in the AI space with groq and tenstorrent.
The problem with asic's today is that in order to get to the same compute density of a AIA, due to AI's need for memory, you need significantly more hardware.
Right now, MI300x is the leader with 192gb, if you do the math on groq, it just doesn't work out. This is part of the reason why the stopped selling to retail and are just focused on hosting services.
It will be a while before the smaller chipmakers can get their hands on enough hbm to make a dent in the AIA market (due to AMD/NV hogging it all). Don't forget that AMD/NV can and will just come out with better designs too.