3 ms·
afaict OpenAI's instance is massively overloaded, you can see with the 32k context model actually being faster in practice rather than slower
by darknoon 3y ago
afaict OpenAI's instance is massively overloaded, you can see with the 32k context model actually being faster in practice rather than slower