3 ms·
That's indeed short for some actual uses such as summarization, but AFAIK many/most? evals involve generating less than 200.
by janwas 2y ago
That's indeed short for some actual uses such as summarization, but AFAIK many/most? evals involve generating less than 200.