4 ms·
Can be, yes. I think besides the context window size though, there is the issue that performance seems to decline as the input size increases. It can become a p
by socketcluster 2y ago
Can be, yes. I think besides the context window size though, there is the issue that performance seems to decline as the input size increases. It can become a problem before you reach the context window size limits.