2 ms·
This is awesome! Is any of it open-source? I’d love to learn more about how the LLM works in the browser.
by jitl 4y ago
This is awesome! Is any of it open-source? I’d love to learn more about how the LLM works in the browser.
- _vxw6 4y agoIt will be very soon https://github.com/haystackoss/haystack https://github.com/haystackoss/haystack some rust code that compiles to WASM loads LLM from memory, and uses custom transformer.py like rust alternative we wrote.