5 ms·

Cutting LLM Costs by 83% with LangSmith

• nick_rocks 3y ago
  83% cost reduction seems impressive, but is this really an issue for anyone?
  • sp332 3y ago
    Well, I heard of one case where a bug was causing queries of 100,000 tokens at a time. https://medium.com/dataherald/cutting-llm-costs-by-83-with-langsmith-e44bb63af2a8 https://medium.com/dataherald/cutting-llm-costs-by-83-with-l...
    • deleted 3y ago
      [deleted]
    • nick_rocks 3y ago
      Fair enough! But have you heard of 2 cases?
• aazo11 3y ago
  Is langsmith still useful if your app is not built with Langchain? Given how early these technologies wouldn't it be better to use a framework agnostic tool to not be tied in to a single framework?