3 ms·Llama 3 had a 8192 token context window. Llama 3.1 increased it to 131072.by ryao 1y agoLlama 3 had a 8192 token context window. Llama 3.1 increased it to 131072.