3 ms·
Does very large context significantly increase a response time? Are there any benchmarks/leader-boards estimating different models in that regard?
by maxnevermind 1y ago
Does very large context significantly increase a response time?
Are there any benchmarks/leader-boards estimating different models in that regard?