7 ms·
In-browser LLM inference engine with WebGPU and OpenAI API
- crowwork 2y agoComes with ability to do full structured generation with json schema also a in-browser demo https://chat.webllm.ai/ https://chat.webllm.ai/
- ruihangl 2y agoIt's good to see that it contains the standard OpenAI API interface in JavaScript which looks very convenient.
- cyx6 2y agoAMAZING!
- leshenj15 2y agoSo cool. No more privacy concerns!