3 ms·
even more naive way - just club several requests into batch of classification requests into one prompt. in practice, this is not production-ready as the llm out
by rldjbpin 2y ago
even more naive way - just club several requests into batch of classification requests into one prompt. in practice, this is not production-ready as the llm output does not always contain results for the same number of input (sometimes more than inputted even!)