3 ms·

Are we looking at the same page? https://imgur.com/a/y6XfpBl https://imgur.com/a/y6XfpBl And even the direct tag page: https://ollama.com/library/mixtral:8x22

Are we looking at the same page? https://imgur.com/a/y6XfpBl https://imgur.com/a/y6XfpBl And even the direct tag page: https://ollama.com/library/mixtral:8x22b https://ollama.com/library/mixtral:8x22b shows 40-something minutes ago: https://imgur.com/a/WNhv70B https://imgur.com/a/WNhv70B

orost 2y ago
Let me clarify. Mixtral-8x22B-v0.1 was released a couple days ago. The "mixtral:8x22b" tag on ollama currently refers to it, so it's what you got when you did "ollama run mixtral:8x22b". It's a base model only capable of text completion, not any other tasks, which is why you got a terrible result when you gave it instructions. Mixtral-8x22B-Instruct-v0.1 is an instruction-following model based on Mixtral-8x22B-v0.1. It was released two hours ago and it's what this post is about. (The last updated 44 minutes ago refers to the entire "mixtral" collection.)
belter 2y ago
I get: ollama run mixtral:8x22b Error: exception create_tensor: tensor 'blk.0.ffn_gate.0.weight' not found
- Me1000 2y ago
  You need to update ollama to 0.1.32.
  - belter 2y ago
    Thanks. That did it.
gliptic 2y ago
And where does it say that's the instruct model?