3 ms·
How much does it cost to privately fine-tune and run Llama? It’s USD 600 for fine-tuning. Maybe USD 4-5k for a computer that can run it. ChatGPT pro is $20/mo
by nico 4y ago
How much does it cost to privately fine-tune and run Llama?
It’s USD 600 for fine-tuning. Maybe USD 4-5k for a computer that can run it.
ChatGPT pro is $20/month. 5k would be 250 months (10+ years) of paid access.
Not sure pirating it now adds up.
- zamnos 4y agoCorrect me if I'm wrong, but that's per-user, unless you all just share an account, or you build out a bespoke API integration. Which is to say if you have 25 developers, you'd spend $5k in 1 month. The reason to pirate it would to be able to fine-tune the model on your private internal source code repository, assuming you already have an existing large body of work you want to train it and offer SelfHostedCoPilot on your bespoke internal-only DSL that ChatGPT and Copilot has no way of having seen and would undoubtedly hallucinate about by a considerable margin.
- mromanuk 4y agoMost people doesn’t fine tune the models (llama or openAI). A MacBook M1 can run those model ($1000) and in many cases the user already have it. You also need a computer to access openAI, the comparison boils down to $20/m vs $0. At this point in time, LLM are a curiosity for most people