6 ms·
I feel that a LLM that runs locally has its place in a modern browser. The alternative is sending your page contents to a server in the cloud with the associate
by Tepix 6mo ago
I feel that a LLM that runs locally has its place in a modern browser. The alternative is sending your page contents to a server in the cloud with the associated loss of privacy.
Of course issues like fingerprintability and vendor model lockin have to be taken into account. It seems to be too early to carve things in stone, so I agree with Brian Grinstead and the others.
- wavemode 6mo agoThe alternative is that web pages just don't run inference? Why is that something a web page should expect to have a right to? If you want to burn a bunch of GPU heat, spend it on your own servers, not my computer. Either way, if this does happen I definitely hope it gets put behind a brower permission.
- Tepix 6mo agoIt already is, the first time you use it you have to download the weights and you can just abort at that point.