3 ms·
Tokens saved should not be your north star metric. You should be able to show that tool call performance is maintained while consuming fewer tokens. I have no i
by stephantul 7mo ago
Tokens saved should not be your north star metric. You should be able to show that tool call performance is maintained while consuming fewer tokens. I have no idea whether that is the case here.
As an aside: this is a cool idea but the prose in the readme and the above post seem to be fully generated, so who knows whether it is actually true.
- hrmtst93837 7mo ago[flagged]
- stephantul 7mo agoAre you an llm? That would be so ironic
- danlitt 7mo agoI found this comment because I was wondering the same thing on a completely unrelated thread. I strongly suspect this is a bot.
- hrmtst93837 7mo ago[flagged]
- danlitt 7mo agook, I'll stop. I am not the only person who suspected you!
- hrmtst93837 7mo ago[flagged]
- stephantul 7mo agoThis is such a funny interaction
- hrmtst93837 7mo ago[flagged]
- deleted 7mo ago[deleted]
- hrmtst93837 7mo ago[flagged]
- rakag 7mo agoThe AI prose is getting so tiring to read "We measured this. Not estimates — actual token counts using the cl100k_base tokenizer against real schemas, verified by an automated test suite."