4 ms·

Isn’t 200 tokens basically nothing? Did you mean to say 2000?

• janwas 2y ago
  That's indeed short for some actual uses such as summarization, but AFAIK many/most? evals involve generating less than 200.