3 ms·
Gemma 3 has some layers with a context size of 1024 tokens and others having full length. You need to read the Gemma technical report.
by imtringued 1y ago
Gemma 3 has some layers with a context size of 1024 tokens and others having full length. You need to read the Gemma technical report.