6 ms·
Yes but if a 7b LLM will give you the same “Hello World” as the 70b, and that’s literally all you need, using a bigger model is just burning energy for no reaso
by sjwhevvvvvsj 3y ago
Yes but if a 7b LLM will give you the same “Hello World” as the 70b, and that’s literally all you need, using a bigger model is just burning energy for no reason at all.
- huytersd 3y agoThe cost is fixed for me at least at this point so why would I choose the inferior version.
- sjwhevvvvvsj 3y agoIt’s not fixed whatsoever. Mistral 7B runs on a MacBook Air, and it’s free. Zero cost LLM, no network latency.