3 ms·
Mixtral 8x7B has 32k context. Mistral 7b instruct 0.2 is just an instruct fine tune of Mistral 7b and stays with a 8k context.
by tarruda 3y ago
Mixtral 8x7B has 32k context.
Mistral 7b instruct 0.2 is just an instruct fine tune of Mistral 7b and stays with a 8k context.