3 ms·

Gemini Nano coming built in to Chrome 126, powered by WebGPU

• Hugsun 2y ago
  According to the paper[1], Gemini Nano-1 is 1.8B, and (Nano-2) is 3.25B parameters. They are quantized to 4-bits which makes them 0.9GB and 1.6GB respectively. That's a juicy binary blob to ship with Chrome. As this will be on device, it will be interesting to see the inevitable reverse engineering of the model, if Google doesn't just release the weights. [1]: https://arxiv.org/pdf/2312.11805 https://arxiv.org/pdf/2312.11805
  • morbicer 2y ago
    Yeah, that's beefy. Although if it's available to websites as a browser api it can allow for some interesting applications. I guess that's unlikely, but perhaps at least to plugins? Open-web me screams no but tinkering me says yeah!
  • jfoster 2y ago
    ~1 GB built into the browser is a lot better than ~1 GB being stored by several websites/apps. It is a bit of a concern for low-powered devices and mobile, though.