3 ms·
A 1B model at 2-bit quantization is about the size of the average web page anymore. With some WebGPU support you could run such a model in a browser. I'm half
by giantrobot 1y ago
A 1B model at 2-bit quantization is about the size of the average web page anymore. With some WebGPU support you could run such a model in a browser.
I'm half joking. Web pages are ludicrously fat these days.
- reverius42 1y agoSomething like this? https://github.com/huggingface/transformers.js-examples/tree/main/llama-3.2-webgpu https://github.com/huggingface/transformers.js-examples/tree...
- giantrobot 1y agoThat was the exact thing I was thinking of but couldn't remember the project name. Thanks!