2 ms·
Next up....WebGPU chatbot? ChatGPT style chat with your own GPU in the browser?
by aussieguy1234 3y ago
Next up....WebGPU chatbot? ChatGPT style chat with your own GPU in the browser?
- brucethemoose2 3y agoAlso already done... With some limitations. LLMs are especially tricky for WebGPU because the good models are so RAM/VRAM heavy.
- moffkalast 3y agohttps://webllm.mlc.ai/ https://webllm.mlc.ai/ Already done.