4 ms·
From what I've gathered from the Tenstorrent discord: The grayskull cards only have 8 GB of RAM and don't have a fast enough memory to NoC bandwidth to make wo
by camel-cdr 3y ago
From what I've gathered from the Tenstorrent discord:
The grayskull cards only have 8 GB of RAM and don't have a fast enough memory to NoC bandwidth to make working with multiple cards practical. The next generations, that is wormhole and newer don't have this limitations and are specifically designed to work in server racks, see the galaxy system. [0]
The Grayskull really only is a devboard. It has some other quirks that will be improved by wormhole, like native 19 bit floats in their SIMT engines, instead of 32 bit, in wormhole.
[0] https://tenstorrent.com/systems/galaxy/ https://tenstorrent.com/systems/galaxy/