3 ms·
George Hotz – Programming – can we fit a LLaMA inside a tinygrad?
- diimdeep 4y agoLLaMA 7B on M1 GPU, 3 tokens/s https://github.com/geohot/tinygrad/tree/llama https://github.com/geohot/tinygrad/tree/llama
- amrb 4y agoI'm waiting for the open assistant dataset, as this model is wicked fast in output and I'd love to see it fine tuned https://github.com/BlinkDL/RWKV-LM https://github.com/BlinkDL/RWKV-LM