3 ms·
Agreed! On open source though - can't you just pull the model and use the weights? I confess I have no idea what the licensing would be for an open source-backe
by vessenes 1y ago
Agreed! On open source though - can't you just pull the model and use the weights? I confess I have no idea what the licensing would be for an open source-backed browser deploying weights, but it seems like unless you made a huge amount of money off it, it would be unproblematic, and even then could be just fine.
- anahas 1y agoSure you could but now you have two identical models running in the browser, one of which needs to be loaded in. Ideally they would expose the model via a browser api like they do for the prompt api. FWIW I asked someone on the chrome team about this and they don’t plan to expose native embedding APIs citing lack of dimensionality standards as the reason.
- jbellis 1y agoyou need to know its architecture to run inference against it possibly this is buried in the Chromium source if it's part of the OSS personality, if not difficulty of reverse engineering would be pretty high