3 ms·
I think better SIMD support for webassembly is more inclusive than relying on / expecting WebGPU
by lxe 3y ago
I think better SIMD support for webassembly is more inclusive than relying on / expecting WebGPU
- jmayes 3y agoFor this blog post we are using Chrome for the testing environment which has WebGPU turned on by default now and other common browsers should hopefully follow suit, but given we are using Chrome here we know WebGPU will be available if the WebAI is using that (which many people are turning to for diffusion models and LLMs as its so much faster to run those types of models). But yes, I am all for better support on all the things too, we have many WASM users too, and when anything new comes out there, this set of instructions can still be used to leverage testing that too as its just Chrome running on Linux essentially with the right flags set.
- NavinF 3y agoCPU inference is 10x slower. Not good enough for most use cases