3 ms·

> In its current state, can you train on PyTorch, export to ONNX, load ONNX in JavaScript/WASM, then use it for WebGPU inference? I believe so. Onnxruntime ver

by paulgb 3y ago

> In its current state, can you train on PyTorch, export to ONNX, load ONNX in JavaScript/WASM, then use it for WebGPU inference? I believe so. Onnxruntime very recently merged a WebGPU backend: https://news.ycombinator.com/item?id=35694553 https://news.ycombinator.com/item?id=35694553 You can also go directly from PyTorch to WebGPU with Apache TVM. (ONNX is also supported, but my understanding is that it's better to go direct). This is an example using an LLM trained with PyTorch (I think) and run in the browser: https://mlc.ai/web-llm/ https://mlc.ai/web-llm/

MuffinFlavored 3y ago
I can't seem to figure if the PR for the WebGPU backend for onnxruntime is supposed to land in a 1.14 release, a 1.15 release, has already landed, isn't yet scheduled to land, etc? https://github.com/microsoft/onnxruntime/pull/14579 https://github.com/microsoft/onnxruntime/pull/14579 https://github.com/microsoft/onnxruntime/releases https://github.com/microsoft/onnxruntime/releases I don't see it in any releases yet? https://github.com/microsoft/onnxruntime/milestone/4 https://github.com/microsoft/onnxruntime/milestone/4 I don't see it in the upcoming milestone. I don't see any examples or docs that go with it https://github.com/microsoft/onnxruntime/wiki/Upcoming-Release-Roadmap https://github.com/microsoft/onnxruntime/wiki/Upcoming-Relea... This seems to be out of date https://github.com/microsoft/onnxruntime/tree/rel-1.15.0 https://github.com/microsoft/onnxruntime/tree/rel-1.15.0 I do see the js/webgpu work merged into here so I guess it'll be released in 1.15.0 https://onnxruntime.ai/docs/reference/releases-servicing.html https://onnxruntime.ai/docs/reference/releases-servicing.htm... > Official releases of ONNX Runtime are managed by the core ONNX Runtime team. A new release is published approximately every quarter, and the upcoming roadmap can be found here. ONNX Runtime v1.14.0 was Feb 10th

by paulgb 3y ago

MuffinFlavored 3y ago

I can't seem to figure if the PR for the WebGPU backend for onnxruntime is supposed to land in a 1.14 release, a 1.15 release, has already landed, isn't yet scheduled to land, etc? https://github.com/microsoft/onnxruntime/pull/14579 https://github.com/microsoft/onnxruntime/pull/14579 https://github.com/microsoft/onnxruntime/releases https://github.com/microsoft/onnxruntime/releases I don't see it in any releases yet? https://github.com/microsoft/onnxruntime/milestone/4 https://github.com/microsoft/onnxruntime/milestone/4 I don't see it in the upcoming milestone. I don't see any examples or docs that go with it https://github.com/microsoft/onnxruntime/wiki/Upcoming-Release-Roadmap https://github.com/microsoft/onnxruntime/wiki/Upcoming-Relea... This seems to be out of date https://github.com/microsoft/onnxruntime/tree/rel-1.15.0 https://github.com/microsoft/onnxruntime/tree/rel-1.15.0 I do see the js/webgpu work merged into here so I guess it'll be released in 1.15.0 https://onnxruntime.ai/docs/reference/releases-servicing.html https://onnxruntime.ai/docs/reference/releases-servicing.htm... > Official releases of ONNX Runtime are managed by the core ONNX Runtime team. A new release is published approximately every quarter, and the upcoming roadmap can be found here. ONNX Runtime v1.14.0 was Feb 10th