3 ms·
It's not so much that people want to run the models in the browser. They want to be able to write and publish one desktop app that e.g. runs a LLaMA quality mod
by sebzim4500 4y ago
It's not so much that people want to run the models in the browser. They want to be able to write and publish one desktop app that e.g. runs a LLaMA quality model and runs decently across the hundreds of different GPUs that exist on their users' machines.
- tikkun 4y agoSo it's more of a CUDA alternative for building desktop apps that are GPU powered?
- deleted 4y ago[deleted]
- dm33tri 4y agoNowhere near CUDA. Maybe OpenCL and Metal replacement because nobody bothers to support them, so just a fallback option for AMD and ARM chips.
- tikkun 4y agoSo then: If your app needs CUDA, you'd need to write it in CUDA. If you don't need CUDA, you'd write it for WebGPU instead? If you benefit from CUDA but don't strictly require it, then you can write it in CUDA with a WebGPU fallback. Is that right?
- dm33tri 4y agoI think you only write WebGPU code if you are using JS or Rust for your hobby project