5 ms·
Unrelated, but now I'm curious about how much would it take on RPis 4 and 5.
by leonidasv 3y ago
Unrelated, but now I'm curious about how much would it take on RPis 4 and 5.
- refulgentis 3y agoyeah me too...I've been very negative about the edge, it got overhyped with the romanticization of local LLMs, but there's a bunch of stuff coming together at the same time...Raspberry Pi 5...Mistral 7B Orca is my 20th try of a local LLM...and the first time it handled simple conversation with RAG. And new diffusion, even every 2 hours, is a credible product, arguing about power consumption aside...