3 ms·
That really depends on the complexity of your request and any prompt engineering techniques in use for that request. Especially with "think step by step" in cer
by selfhoster11 3y ago
That really depends on the complexity of your request and any prompt engineering techniques in use for that request. Especially with "think step by step" in certain contexts, it can improve answer quality at the expense of generation time (because more tokens are emitted).