3 ms·
Not all neural network models are necessarily very large, or language models: For example, many chess engines these days are already based on neural networks,
by lxgr 3y ago
Not all neural network models are necessarily very large, or language models:
For example, many chess engines these days are already based on neural networks, and these run pretty well in WASM (for example, Stockfish, one of the strongest engines, has a 7M and a 44M version on lichess.org), but as far as I understand that's mostly because they're optimized for CPU usage.
It would be pretty cool to be able to run similar specialized models on the best execution resources a device has available and not just the CPU (or maybe a GPU via WebGPU).
- jfoster 3y agoThat's true for chess engines, but almost every use-case listed in the WebNN specification currently requires a fairly large model. Certainly not things you would want every website downloading duplicate copies of.
- lxgr 3y ago> almost every use-case listed in the WebNN specification currently requires a fairly large model Do they? At least some of them seem much smaller than Stockfish's NNUE.
- jfoster 3y agoCould be I suppose, but what about others? I guess the problem I see is that any given webapp might need to download & store several gigabytes. If the models were built into the browser, the browser would need to download & store the model data, but that can at least be a lot more efficient than websites doubling up on download & storage of models.