5 ms·
Absolutely, there are tons of cases where interactive experience is not required, but ability to process large context to get insights.
by anuarsh 1y ago
Absolutely, there are tons of cases where interactive experience is not required, but ability to process large context to get insights.
- attogram 1y agoIt would be interesting to see some benchmarks of this vs, for example, Ollama running localy with no timeout