3 ms·
310 tok/sec on my browser, hm.
by stavros 2mo ago
310 tok/sec on my browser, hm.
- HenryNdubuaku 2mo agoNow you can try running the python package directly on your Mac to see proper speedup. WebAssembly has some limitations, running on pure hardware, especially ARM-based to see thousands (which 99% of consumer devices are ARM).