4 ms·
Hear hear! I don't understand why it has persistent mindshare, it's not even trained for chat. Meanwhile StableLM 3B runs RAG in my browser, on my iPhone, on my
by refulgentis 3y ago
Hear hear! I don't understand why it has persistent mindshare, it's not even trained for chat. Meanwhile StableLM 3B runs RAG in my browser, on my iPhone, on my Pixel ..
- djsavvy 3y agoHow have you been using RAG in your browser/on your phones?
- refulgentis 3y agoTo be released, someday [sobs in engineer] Idea is usage-based charging for non-local and a $5/month sub for syncing. keep an eye on @jpohhhh on Twitter if you're interested now that I got it on web, I'm hoping to at least get a PoC up soon. I've open-sourced the consitutent parts as FONNX and FLLAMA, Flutter libraries that work on all platforms. FONNX has embeddings, FLLAMA has llama. https://github.com/Telosnex/fonnx https://github.com/Telosnex/fonnx https://github.com/Telosnex/fllama https://github.com/Telosnex/fllama