3 ms·

Assuming you have Ollama installed, you can test this with `ollama run yi:34b`.

• hedgehog 3y ago
  I think something is off about the current Ollama support, at least with the smaller 6b model it seems to generate near gibberish.
  • rsolva 3y ago
    Yeah, can confirm (6B model), it feels like I'm interacting with an untrained model, no fine-tuning.
    • jmorgan 3y ago
      The 6B model is unfortunately still a base text completion model. I've been waiting for the Chat version it to be open-sourced :). The 01-ai team is working on it! https://github.com/01-ai/Yi/issues/173 https://github.com/01-ai/Yi/issues/173
      • hedgehog 3y ago
        Aha, that would do it. As an aside the amount of stuff baked into these models is impressive, I tried using the dolphin2.2-mistral 7B model to translate bits of that ticket and it did just fine. >>> Translate: 如题 The title suggests: "As the topic" >>> 关于模型，hugggingface上只看到，34B chat是有的，6B还没上传吗 Regarding the model, on Hugging Face, I only see a 34B chat, is the 6B not uploaded yet?
    • Filligree 3y ago
      The 34b model took hours to download, but once I was able to play with it... I'm impressed. This feels almost like talking to a (dumber) GPT-4, not at all like the only semi-coherent models I'm used to. It does stop following my instructions once the context window fills up, but for a 34B parameter model it's amazing.