3 ms·
I’d wager it could cost anywhere between 1-10k to do that, which is a considerable amount of money. Might still be worth it though? If the alternative is mechan
by manmal 4y ago
I’d wager it could cost anywhere between 1-10k to do that, which is a considerable amount of money. Might still be worth it though? If the alternative is mechanical turk, that would probably cost x1000-10000? Are there any ML alternatives that reliably produce useful results?
- MacsHeadroom 4y agoIt would cost less than $50 of compute to finetune an existing open source LLM to do the job for another $50 of computer. OpenAI's APIs are incredibly expensive compared to powerful open source LLMs which run on very accessible hardware. As one data point, LLaMA-13B beats GPT-3 175B in benchmarks, runs on a single 8GB VRAM consumer GPU, and takes only 24GB of VRAM to fine tune. (Though this particular model can't be used for commercial purposes.)
- manmal 4y agoI actually read about LLaMA after posting the above comment, and I do agree with you. You probably can't use it OOTB right now because LLaMA prompts seem harder to get right, but seeing the rate of progress, that will probably be solved in a few weeks.