4 ms·

Can't wait for the wasm in-browser implementation on HN tomorrow...

• xena 4y ago
  I'm pretty sure that a WASM option isn't going to happen any time soon. The 7B model is 4 GB at int4. WASM has 32 bit addresses and a limit of 4 GB of ram. Maybe this will make wasm64 more of a thing.
  • antupis 4y ago
    so we are going get wasm64 tomorrow...
    • TOMDM 4y ago
      And llama in wasm the day after