3 ms·

Yes, it only starts the download after you send the first message so visiting the site won’t use up any space. Approx sizes are listed in the GitHub README. M

by abi 2y ago

Yes, it only starts the download after you send the first message so visiting the site won’t use up any space. Approx sizes are listed in the GitHub README. Models are stored in indexeddb and will be managed by the browser. Might get evicted.

simonw 2y ago
I see you have Phi1.5-q4f16_1-1k - any chance you could add Phi-3?
- abi 2y ago
  Would love to. It uses MLC AIs webllm so just need to convert it to that format.
- FL33TW00D 2y ago
  Phi3 is already available in browser here: https://huggingface.co/spaces/FL33TW00D-HF/ratchet-phi https://huggingface.co/spaces/FL33TW00D-HF/ratchet-phi Disclaimer: I am the author.
kamikazeturtles 2y ago
I thought browser tabs only had access to ~400mb How do you have access to 5gb?
- zamadatix 2y ago
  A lot of the more modern options allow for many gigabytes for typical user setups https://developer.mozilla.org/en-US/docs/Web/API/Storage_API/Storage_quotas_and_eviction_criteria#:~:text=Each%20browser%20determines%2C%20using%20whatever%20mechanism%20it%20chooses%2C%20the%20maximum%20amount%20of%20storage%20a%20given%20origin%20can%20use https://developer.mozilla.org/en-US/docs/Web/API/Storage_API....
  - kamikazeturtles 2y ago
    Very interesting! Thank you so much I was always under the impression that the max blob size was 400mb and so you couldn't store files any bigger than that. Google gives so many different answers to these questions. Do you know any other resources I can go more in depth on browser storage limits?