3 ms·
It's not hopeless, but it requires so much money and time that you might as well surrender all hope. Competing with OpenAI is tough, finetuning llama to a point
by smoldesu 3y ago
It's not hopeless, but it requires so much money and time that you might as well surrender all hope. Competing with OpenAI is tough, finetuning llama to a point that it competed with GPT3.5 required several finetuning attempts and many months of research.
There's still room for more AI models, but competitive ones are remarkably difficult to build. Competing with OpenAI's thousands of GPUs is not an easy feat.
- nutanc 3y agoWhat if we have an alternative to deep learning that does not need those thousands of GPUs?
- smoldesu 3y agoThen it would have to compete with OpenAI's solution, which is no easy feat. I'd be interested in hearing more about this alternative, though.
- nutanc 3y agoHave written a little about it here, https://gpt3experiments.substack.com/p/building-a-new-embeddingbit-vector https://gpt3experiments.substack.com/p/building-a-new-embedd... Will do a bigger blog post soon on the approach. Can mail you some details if you are interested.