4 ms·
Just telling the llm to preface it's conclusion with "Answer:" in a parseable way would be better. You're still paying for those thinking tokens, or at the ver
by monsieurbanana 2y ago
Just telling the llm to preface it's conclusion with "Answer:" in a parseable way would be better.
You're still paying for those thinking tokens, or at the very least have to wait for them to be generated.