3 ms·
Seeing it be pretty slow in production with long prompts: - 10-15 seconds for 400 tokens out, and 4,000-10,000 tokens in. - 6-8 seconds when using Claude Inst
by BoorishBears 3y ago
Seeing it be pretty slow in production with long prompts:
- 10-15 seconds for 400 tokens out, and 4,000-10,000 tokens in.
- 6-8 seconds when using Claude Instant for the same prompts
Hoping it's just a rush at launch.