3 ms·

83% cost reduction seems impressive, but is this really an issue for anyone?

• sp332 3y ago
  Well, I heard of one case where a bug was causing queries of 100,000 tokens at a time. https://medium.com/dataherald/cutting-llm-costs-by-83-with-langsmith-e44bb63af2a8 https://medium.com/dataherald/cutting-llm-costs-by-83-with-l...
  • deleted 3y ago
    [deleted]
  • nick_rocks 3y ago
    Fair enough! But have you heard of 2 cases?