5 ms·
i'm also interested in tenstorrent. they're building GPUs with cheap GDDR6 using a fast SRAM cache, and writing their own compiler stack (used instead of CUDA)
by woodrowbarlow 3mo ago
i'm also interested in tenstorrent. they're building GPUs with cheap GDDR6 using a fast SRAM cache, and writing their own compiler stack (used instead of CUDA) that pipelines data to the SRAM ahead-of-time so you (in theory) never need to suffer the slow speed of GDDR6 for AI workloads. also they've got built-in SFP cages where the video ports would normally be.
- inigyou 3mo agoIs tenstorrent building GPUs now, not just tensor processors?
- woodrowbarlow 3mo agoyou're right, i misspoke by saying it's a GPU since it doesn't have video output. the just-in-time data pipelining wouldn't work for graphics workloads anyway.