3 ms·
I know there's some overhead, it's not my calculation. https://www.tweaktown.com/news/97110/tinycorps-new-tinybox-ai-system-amd-gpu-starts-at-15k-nvidia-25k/in
by Tepix 3y ago
I know there's some overhead, it's not my calculation.
https://www.tweaktown.com/news/97110/tinycorps-new-tinybox-ai-system-amd-gpu-starts-at-15k-nvidia-25k/index.html https://www.tweaktown.com/news/97110/tinycorps-new-tinybox-a...
Quote: "Runs 70B FP16 LLaMA-2 out of the box using tinygrad"
Related: https://github.com/tinygrad/tinygrad/issues/3791 https://github.com/tinygrad/tinygrad/issues/3791