4 ms·

> "...including BERT for natural language processing tasks, ResNet for image recognition, Whisper for speech recognition and translation, YOLOv5 for real-time o

> "...including BERT for natural language processing tasks, ResNet for image recognition, Whisper for speech recognition and translation, YOLOv5 for real-time object detection, and U-Net for image segmentation." I wonder why they are starting with these models. One could speculate that they are going for power efficiencies but that does not quite add up entirely.

camel-cdr 3y ago
From what I've gathered from the Tenstorrent discord: The grayskull cards only have 8 GB of RAM and don't have a fast enough memory to NoC bandwidth to make working with multiple cards practical. The next generations, that is wormhole and newer don't have this limitations and are specifically designed to work in server racks, see the galaxy system. [0] The Grayskull really only is a devboard. It has some other quirks that will be improved by wormhole, like native 19 bit floats in their SIMT engines, instead of 32 bit, in wormhole. [0] https://tenstorrent.com/systems/galaxy/ https://tenstorrent.com/systems/galaxy/
deleted 3y ago
[deleted]
hhh 3y ago
YOLOv5 is pretty widely used, and it can be useful to get efficient compute at the edge. Disclosure: I work for a Tenstorrent customer.
VHRanger 3y ago
> I wonder why they are starting with these models. They were building Greyskull in 2020/2021 initially. BERT_Large and similar were the SOTA at that time.
transitionnel 3y ago
Like Intel SSE for media optimization probably? Those models do seem to be the best currently available (IMO), so yeah power efficiencies for guaranteed common use cases should be a 0-day integration.
- transitionnel 3y ago
  Which reminds me... Hope those libraries are open and vetted...
binarymax 3y ago
Next-gen BERT models are still very popular for embeddings.
usrusr 3y ago
Highly speculative, and I suspect that I don't do these models justice: The purpose of these boards seems to get people acquainted with their programming model. Not as in using board and model as a turnkey solution (if that happens, fine, but this is not the goal), but as in getting potential customers for future boards to learn how to make their own models or third party models run on the board. The more models they supported out of the box, the less well the goal of building buyer-side expertise in the programming model would be served.

camel-cdr 3y ago

From what I've gathered from the Tenstorrent discord: The grayskull cards only have 8 GB of RAM and don't have a fast enough memory to NoC bandwidth to make working with multiple cards practical. The next generations, that is wormhole and newer don't have this limitations and are specifically designed to work in server racks, see the galaxy system. [0] The Grayskull really only is a devboard. It has some other quirks that will be improved by wormhole, like native 19 bit floats in their SIMT engines, instead of 32 bit, in wormhole. [0] https://tenstorrent.com/systems/galaxy/ https://tenstorrent.com/systems/galaxy/

deleted 3y ago

[deleted]

hhh 3y ago

YOLOv5 is pretty widely used, and it can be useful to get efficient compute at the edge. Disclosure: I work for a Tenstorrent customer.

VHRanger 3y ago

> I wonder why they are starting with these models. They were building Greyskull in 2020/2021 initially. BERT_Large and similar were the SOTA at that time.

transitionnel 3y ago

Like Intel SSE for media optimization probably? Those models do seem to be the best currently available (IMO), so yeah power efficiencies for guaranteed common use cases should be a 0-day integration.

transitionnel 3y ago
Which reminds me... Hope those libraries are open and vetted...

binarymax 3y ago

Next-gen BERT models are still very popular for embeddings.

usrusr 3y ago

Highly speculative, and I suspect that I don't do these models justice: The purpose of these boards seems to get people acquainted with their programming model. Not as in using board and model as a turnkey solution (if that happens, fine, but this is not the goal), but as in getting potential customers for future boards to learn how to make their own models or third party models run on the board. The more models they supported out of the box, the less well the goal of building buyer-side expertise in the programming model would be served.