3 ms·
Hopefully RedPajama will change things when (if) they release models based on their independent LLaMa recreation. Until that happens, it might make sense to us
by CamperBob2 4y ago
Hopefully RedPajama will change things when (if) they release models based on their independent LLaMa recreation. Until that happens, it might make sense to use the LLaMa model as a stopgap for internal development.
- OkGoDoIt 4y agoExactly! It seems pretty clear that someone will reproduce llama and alpaca with a commercially viable model within the next few months to a year at the longest. So if you want to build something based on top of this technology, it makes sense to build it on top of llama/alpaca internally, and then swap it out with something commercially licensed when it’s available. Then you’ve got a huge head start on anyone who is waiting for the stars to align before they start trying to build something at all.