3 ms·
for me, the 2.5B model for gemma (now 1) was very interesting as that was the first major offering at this size level. for basic llm tasks that most people wou
by rldjbpin 2y ago
for me, the 2.5B model for gemma (now 1) was very interesting as that was the first major offering at this size level.
for basic llm tasks that most people would use on their daily lives (simple rag on your own data), it did the job for the most part (unless you need a lot of context maybe).
on paper the newer one shows significant improvement with slightly larger size, but i hope HumanEval regression is not going to matter for most people.