3 ms·

How come the answers for Mixtral 8x7B-32k and Llama 2 70B-4k are identical? After asking via Mixtral a couple of questions I switched to Llama, and while it sh

How come the answers for Mixtral 8x7B-32k and Llama 2 70B-4k are identical? After asking via Mixtral a couple of questions I switched to Llama, and while it shows Llama as the Model used for the response, the answer is identical. See first and last question: https://pastebin.com/ZQV10C8Q https://pastebin.com/ZQV10C8Q

tome 3y ago
Yeah, it's confusing. See here for an explanation: https://news.ycombinator.com/item?id=39431921 https://news.ycombinator.com/item?id=39431921
- qwertox 3y ago
  Thanks! And congrats, the speed is impressive and quality really good.
- modeless 3y ago
  Oh yeah you definitely need to change that ASAP or at least add an explanation. I also thought there was something fishy going on. Thanks for the explanation.