3 ms·
Commercial service have a context of 64k tokens, which I find quite limiting. https://api-docs.deepseek.com/quick_start/pricing https://api-docs.deepseek.com/q
by siscia 2y ago
Commercial service have a context of 64k tokens, which I find quite limiting.
https://api-docs.deepseek.com/quick_start/pricing https://api-docs.deepseek.com/quick_start/pricing
Running it locally is quite a bit beyond the scope of being productive while coding with AI.
Beside that 128k is still significantly less than Claude
- elashri 2y agoShouldn't we be comparing with other open source model? In particular since this is about llama3.3 then they have the exact context limit which is 128k [1]. Also [1] https://huggingface.co/meta-llama/Llama-3.3-70B-Instruct https://huggingface.co/meta-llama/Llama-3.3-70B-Instruct
- siscia 2y agoWhy? Whenever using a model to be more effective as a developer I don't particularly care if the model is open source or closed source. I would love to use open source models as well, but the convenience to just plug an API against some endpoints in unbeatable.