I'm currently working on an open-source LLM inference engine [1] for browsers via webGPU. If anyone wants to try or has any suggestions, I'm happy to listen :)

I'm currently working on an open-source LLM inference engine [1] for browsers via webGPU. If anyone wants to try or has any suggestions, I'm happy to listen :) 1. https://github.com/stfurkan/bitgpu https://github.com/stfurkan/bitgpu Demo: https://stfurkan.github.io/bitgpu/examples/chat.html https://stfurkan.github.io/bitgpu/examples/chat.html 2. https://aidekin.com https://aidekin.com --> this is one of my project that's currently using bitgpu engine