4 ms·
Unless something changed, I thought it was that they literally cannot legally release the weights that are based on LLaMA (except maybe with an xor thing) so th
by circuit10 4y ago
Unless something changed, I thought it was that they literally cannot legally release the weights that are based on LLaMA (except maybe with an xor thing) so they’re going to train it based on something else
- mindcrime 4y agoIs any of the Open Assistant stuff based on LLaMA? I thought they release (at least some version) before LLaMA even dropped?
- circuit10 4y agoYes, there’s also something based on Pythia but it’s a smaller model
- selfhoster11 4y agoIIRC, the video said they will train it on a properly open-source model as well.