4 ms·
I won't even take a look at the numbers unless they show a PyTorch model running on it, the problem is the big disconnect between HW and SW, realistically, have
by hyuen 4y ago
I won't even take a look at the numbers unless they show a PyTorch model running on it, the problem is the big disconnect between HW and SW, realistically, have you ever seen any off-the shelf model running on something other than NVidia?
- deleted 4y ago[deleted]
- Narew 4y agoIt's for inference only not training. In this use case, there is lots of device that's not Nvidia. For server you have Google tpu, for more close to public there is the Apple Neural Engine for example.
- kombine 4y agoThat. I work on the research side and I am still waiting for non-NVIDIA hardware for training deep models.
- frozenport 4y agoGoogle's TPU comes to mind
- hhh 4y agoI've ran models on Apple HW, Raspberry Pi, random CPUs, NVIDIA GPUs, TPUs. Waiting to get my hands on Tenstorrent gear.