3 ms·
Given the cost of running an LLM for 10 minutes, yes it does matter. That's about 15 dollars. The overall answer better be very good and relevant every time fo
by hirako2000 2y ago
Given the cost of running an LLM for 10 minutes, yes it does matter. That's about 15 dollars.
The overall answer better be very good and relevant every time for this to tech to make sense.
- malux85 2y agoOh that’s a good point, I have my own GPU rack and run locally because it’s cheaper to do so, so I hadn’t considered that…