4 ms·
Related. I built karpathy’s llama2.c (https://github.com/karpathy/llama2.c https://github.com/karpathy/llama2.c) without modifications to WASM and run it in the
by dmarcos 3y ago
Related. I built karpathy’s llama2.c (https://github.com/karpathy/llama2.c https://github.com/karpathy/llama2.c) without modifications to WASM and run it in the browser. It was a fun exercise to directly compare native vs. Web perf. Getting 80% of native performance on my M1 Macbook Air and haven’t spent anytime optimizing the WASM side.
Demo: https://diegomarcos.com/llama2.c-web/ https://diegomarcos.com/llama2.c-web/
Code:
https://github.com/dmarcos/llama2.c-web https://github.com/dmarcos/llama2.c-web