2 ms·

Can you share a bit more about how you accomplished it? Is this using Llama? I’d love to load the 1B version of Llama for my extension: https://chromewebstore.

• orenha 2y ago
  I am using hugging face transformer.js for that. https://huggingface.co/docs/transformers.js/en/index https://huggingface.co/docs/transformers.js/en/index You can also take a look at Webllm library. https://github.com/mlc-ai/web-llm https://github.com/mlc-ai/web-llm In the future, google will probably load Gemini nano into chrome, right now it's in beta - https://developer.chrome.com/docs/ai/built-in https://developer.chrome.com/docs/ai/built-in