3 ms·
Hang on, starting benchmarks on my Raspberry Pi.
by kergonath 11mo ago
Hang on, starting benchmarks on my Raspberry Pi.
- euroderf 11mo agoBy the year 2035, toasters will run LLMs.
- pickle-wizard 11mo agoOn a lark a friend setup Ollama on a 8GB Raspberry Pi with one of the smaller models. It worked by it was very slow. IIRC it did 1 token/second.