2 ms·
I've run Vicuna 7B directly in my web browser - https://simonwillison.net/2023/Apr/16/web-llm/ https://simonwillison.net/2023/Apr/16/web-llm/ - and on my iPhone
by simonw 4y ago
I've run Vicuna 7B directly in my web browser - https://simonwillison.net/2023/Apr/16/web-llm/ https://simonwillison.net/2023/Apr/16/web-llm/ - and on my iPhone: https://simonwillison.net/2023/May/1/lets-be-bear-or-bunny/ https://simonwillison.net/2023/May/1/lets-be-bear-or-bunny/
- xrd 4y agoHi Simon. How do I ask questions about that post? I didn't see comments enabled.
- simonw 4y agoAsking them here works fine! I decided not to deal with the moderation overhead of managing comments on my own blog.
- xrd 4y agoTotally get it. Basically I've tried running the demos (the linked demo page) from that project inside Chrome 113. I keep getting a network error. Appears to me that huggingface LFS download, the model obviously, isn't available. I also tried to clone the repository locally but the instructions aren't entirely clear on how to get the models installed. Did you clone and run locally? Or are you using the demo site? Or perhaps in something like Colab?