4 ms·
I don't think it is the cheapest, but the tiny box is an option: https://tinygrad.org/ https://tinygrad.org/
by tuxpenguine 3y ago
I don't think it is the cheapest, but the tiny box is an option:
https://tinygrad.org/ https://tinygrad.org/
- Tepix 3y agoTiny box is for running it at fp16, most other comments here talk about running it with 4bit quantization