abarth23

4 ms·

1. 1.▲
   by abarth23 6mo ago

   Exactly this. To actually visualize the sheer scale of the VRAM wall we are hitting, I recently built an LLM VRAM estimator (bytecalculators.com/llm-vram-calculator). If you play around with the math, you quickly realize that even if w
2. 2.▲
   Show HN: A calculator to expose the hidden infrastructural costs behind RAG(bytecalculators.com)

   2 points by abarth23 6mo ago|0 comments