3 ms·
Mistral 7B Finetuned for 32k Context by AWS
- brucethemoose2 3y agoIt seems to perform best with 16K context, but works well with up to 32K context. This is interesting, especially coming from Amazon, as vanilla Mistral-Instruct is much better than llamav2 7B, and extremely fast on modest hardware.