4 ms·
It indeed works and loads quick. I am more interested currently in the Vicuna 7B example from https://mlc.ai/web-llm/ https://mlc.ai/web-llm/ Also instead of j
by DustinBrett 3y ago
It indeed works and loads quick. I am more interested currently in the Vicuna 7B example from https://mlc.ai/web-llm/ https://mlc.ai/web-llm/
Also instead of just "Update Chrome to v113" the domain owner could sign up for an origin trial https://developer.chrome.com/origintrials/#/view_trial/118219490218475521 https://developer.chrome.com/origintrials/#/view_trial/11821...
- fredrickd 3y agoThanks for the tip!
- DustinBrett 3y agoNp! Although there may still be some special WebGPU features in v113 that make v94-112 less ideal.
- DustinBrett 3y agoI actually just tried this on my own domain and although it enabled WebGPU it had another error, which was: "Find an error initializing the WebGPU device Error: Cannot initialize runtime because of requested maxBufferSize exceeds limit. requested=1024MB, limit=256MB. This error may be caused by an older version of the browser (e.g. Chrome 112). You can try to upgrade your browser to Chrome 113 or later."