4 ms·
> For inference, models should be compiled down directly to WASM or WebGPU I mean, yes? Whether for inference or for training, ML operators are usually impleme
by davidatbu 4y ago
> For inference, models should be compiled down directly to WASM or WebGPU
I mean, yes? Whether for inference or for training, ML operators are usually implemented in compiled low level languages. That implementation might also take advantage of GPUs.
> ... if you're going interpreting a list of operations ...
I'm not sure what "interpreting a list of operators" means here.
To clarify why I mentioned the implementation language, I recently had to modify the source code of Tract to get my model running (I will push that change upstream at some point). I would not have (been able to do that), had tract been written in C++, for example.