3 ms·
Ask HN: Has anyone made a LLM chatbot small enough to run entirely in a browser?
- sfmz 2y agohttps://huggingface.co/spaces/webml-community/llama-3.2-webgpu https://huggingface.co/spaces/webml-community/llama-3.2-webg...
- CharlieDigital 2y agoGoogle has an experimental API in Chrome using Gemini Nano: https://developer.chrome.com/docs/ai/built-in https://developer.chrome.com/docs/ai/built-in A walkthrough showing it in action: https://afficone.com/blog/window-ai-new-chrome-feature-api/ https://afficone.com/blog/window-ai-new-chrome-feature-api/