3 ms·
We can't infer the actual context size from the config. Mistral 7B is basically an 8K model, but was marked as a 32K one.
by brucethemoose2 3y ago
We can't infer the actual context size from the config.
Mistral 7B is basically an 8K model, but was marked as a 32K one.