3 ms·
They don't need to be offloaded to a server, but just optimized: either running in web assembly or running on special machine learning cores (like on Apple devi
by kreetx 6y ago
They don't need to be offloaded to a server, but just optimized: either running in web assembly or running on special machine learning cores (like on Apple devices).
- tpetry 6y agoThe ability to run deep learning inference on cuda, opencl or whatever the browser has access to would be a _BIG_ leap forward to ai in the browser. Maybe an onnx native binding should be available in browsers and the browser can choose the most performant execution engine at runtime.
- moron4hire 6y agoThis is running on the GPU. It's using a WebGL-oriented version of tensorflow. The problem is most likely the sorry state of GPU drivers on macOS, causing your system config to be disallowlisted against having hardware acceleration WebGL enabled by default.