4 ms·
Still awaiting the retail release of that 75w PCIe card with out-of-box PyTorch support. If it can run, say StableDiffusion / LAAMA and family, many more use ca
by ramshanker 3y ago
Still awaiting the retail release of that 75w PCIe card with out-of-box PyTorch support. If it can run, say StableDiffusion / LAAMA and family, many more use cases shall emerge.
Obviously retail price will have to be competitive with Gaming Cards.
My 2 cents.
- VHRanger 3y agoWe've been waiting on it for 2 years.... When I talked with TensTorrent people they claimed it was a $1000 A100 competitor with 16gb RAM. Still waiting on it.
- convivialdingo 3y agoWe're having great luck running Yolo 8 models on cheap intel n5105 boxes. 8gb ram, 256gb SSD, USB3 for ~$150... Ubuntu running ONNX gets us 600ms per frame. Not great, but good enough for now.
- FL33TW00D 3y agoI could most likely make it faster - depending on the YOLO used.
- ramshanker 3y agoI watched the video, apparently they are targeting $1000-$2000, and said even $500 sounds interesting. Maybe, just maybe a highly cut down version, 15 watt model could bring it down to RaspberryPi level price. $45. UsbC interface, if not x4 PCIe. Like, people buy it first, and decide what to do with it latter on. Guess I am going to far down the fantasy lane. ;)
- adgjlsfhk1 3y agoAlmost certainly not. Raspberry pi economics only work since they used a cheap of the shelf CPU. For the first few gens, I highly doubt anything below $200 will make any sense given the unit profit margins they will need.