teilom

6 ms·

1. 1.▲
   by teilom 9mo ago

   +1 on interaction terms + tails : fanout × retries × context growth is where linear token math dies. One thing we do in enzu is make “budget as constraint” executable: we clamp `max_output_tokens` from the budget before the call, and in mul
2. 2.▲
   by teilom 9mo ago

   If you’re trying to estimate before prod, logging these 4 things in a pilot gets you 80% there: - tokens/run (in+out) - tool calls/run (and fanout) - retry rate (timeouts/429s) - context length over turns (P50/P95) Fanou
3. 3.▲
   by teilom 9mo ago

   Background note I wrote (framing + “budget as contract”): https://github.com/teilomillet/enzu/blob/main/docs/BUDGETS_A...
4. 4.▲
   Ask HN: What's your biggest LLM cost multiplier?

   7 points by teilom 9mo ago|6 comments
5. 5.▲
   Show HN: TextPolicy – reinforcement learning for text generation on a MacBook(github.com)

   4 points by teilom 1y ago|0 comments
6. 6.▲
   WikipeQA: An evaluation dataset for both web-browsing agents and RAG systems(huggingface.co)

   1 points by teilom 1y ago|0 comments
7. 7.▲
   by teilom 2y ago

   Yo I am building gofh, I am heavily inspire by the go FastHTML( https://fastht.ml ) Python library. That I prefer over streamlit or gradio. The goal is to dev something to start-up allowing users to build a cool working POC web ap
8. 8.▲
   Gollm (golem) – The alternative to LangChain for Golang(gollm.co)

   1 points by teilom 2y ago|0 comments
9. 9.▲
   Easy to learn, hard to master Prompt Eng in Golang(github.com)

   2 points by teilom 2y ago|0 comments