3 ms·
Have you looked at using the long context (32K) version of the Llama v2 7B released by Together AI? https://together.ai/blog/llama-2-7b-32k https://together.ai
by bugglebeetle 3y ago
Have you looked at using the long context (32K) version of the Llama v2 7B released by Together AI?
https://together.ai/blog/llama-2-7b-32k https://together.ai/blog/llama-2-7b-32k
- 110 3y agoOh neat, thanks for sharing that! Having a 32K offline model is pretty promising. Let me test out how it performs