4 ms·
Thanks! it looks like the wonnx CLI itself falls back to tract to do inference on CPU if a GPU is not available[0], and it also sounds like setting up llvmpipe/
by davidatbu 4y ago
Thanks! it looks like the wonnx CLI itself falls back to tract to do inference on CPU if a GPU is not available[0], and it also sounds like setting up llvmpipe/lavapipe on WASM is much harder (if not impossible?) than just shipping tract, so the approach I'll take is probably a wonnx+tract approach.
[0] https://github.com/webonnx/wonnx/issues/116#issuecomment-1140308255 https://github.com/webonnx/wonnx/issues/116#issuecomment-114...