3 ms·
https://github.com/mlc-ai/web-llm https://github.com/mlc-ai/web-llm basically bringing the power of llms to web browsers via WebGPU. i think it’s useful because
by Crier1002 2y ago
https://github.com/mlc-ai/web-llm https://github.com/mlc-ai/web-llm
basically bringing the power of llms to web browsers via WebGPU. i think it’s useful because it’s better for privacy as nothing leaves your browser.
having that said i dont see how this is feasible yet on a widespread public scale given how computational intensive this is.