3 ms·
The more recent Chinese models are no longer heavily limited by context size. It can easily fit in RAM on a prosumer laptop. (You can also use swap space to ext
by zozbot234 5mo ago
The more recent Chinese models are no longer heavily limited by context size. It can easily fit in RAM on a prosumer laptop. (You can also use swap space to extemd that, since context is only written to once per inference, thus a relatively mild wear-and-tear concern.)
- Our_Benefactors 5mo agoClaude has 1M context window for the enterprise. 128k feels like a toy in comparison.
- sourcecodeplz 5mo agoDeepseek pro/flash both have 1m.