4 ms·

Llama-Cpp-WASM

• mtasic 3y ago
  We are proud to launch our game-changing llama-cpp-wasm engine, a breakthrough in-browser LLM engine that executes on the edge using general purpose computing based on llama.cpp. Desktop browser version is OK. Mobile browser version is WIP.
  • adastra22 3y ago
    Does it use webgpu?
    • mtasic 3y ago
      Nope, it is just Wasm/JS. Please test it on desktop Firefox multi-threading version since it turns out to be the fastest one.
• vitpilen 3y ago
  How does the performance of the desktop versions of Chrome, Safari, and Firefox compare?