5 ms·

I had some good results with Vicuna, but haven't tried it for gaming/fantasy roleplay yet.

• xrd 3y ago
  What specs do you need for vicuna? Can you run it on regular hardware, or are you using a cloud GPU?
  • simonw 3y ago
    I've run Vicuna 7B directly in my web browser - https://simonwillison.net/2023/Apr/16/web-llm/ https://simonwillison.net/2023/Apr/16/web-llm/ - and on my iPhone: https://simonwillison.net/2023/May/1/lets-be-bear-or-bunny/ https://simonwillison.net/2023/May/1/lets-be-bear-or-bunny/
    • xrd 3y ago
      Hi Simon. How do I ask questions about that post? I didn't see comments enabled.
      • simonw 3y ago
        Asking them here works fine! I decided not to deal with the moderation overhead of managing comments on my own blog.
        • xrd 3y ago
          Totally get it. Basically I've tried running the demos (the linked demo page) from that project inside Chrome 113. I keep getting a network error. Appears to me that huggingface LFS download, the model obviously, isn't available. I also tried to clone the repository locally but the instructions aren't entirely clear on how to get the models installed. Did you clone and run locally? Or are you using the demo site? Or perhaps in something like Colab?