3 ms·
Show HN: Run AI models directly in the browser – no server or internet required
- ungreased0675 1y agoVery nice
- nadchif 1y agoThanks :)
- nadchif 1y agoSource code: https://github.com/nadchif/in-browser-llm-inference https://github.com/nadchif/in-browser-llm-inference
- sdotdev 1y agonice tool, can see this actually being useful especially in those times where sites go down for no reason
- attogram 1y agoWhat happens after you close the browser? Is the model still stored locally?
- nadchif 1y agoThe model remains cached in the OPFS. If you're curious about the caching code, it can be found here: https://github.com/ngxson/wllama/blob/c267097dc79df8d23df8bc9544c5b21485de56f8/src/cache-manager.ts#L57 https://github.com/ngxson/wllama/blob/c267097dc79df8d23df8bc...
- roberdam 1y agofantastic tool!, is the limit on the length of the prompt text model dependent? or can be tweaked on the github repo?
- roberdam 1y agoit turn out to be a limit on the html, you can change the maxlength="512" with the chrome console to fit your text