2 ms·
That's just a 4k context too. At a realistic context window of 16-32k tokens, the comparison becomes downright unfair.
by bigyabai 6mo ago
That's just a 4k context too. At a realistic context window of 16-32k tokens, the comparison becomes downright unfair.