3 ms·
Qwen 2 uses GQA, has a much longer context length, and covers many new languages. You can't do that with the same architecture and dataset.
by causal 2y ago
Qwen 2 uses GQA, has a much longer context length, and covers many new languages. You can't do that with the same architecture and dataset.