2 ms·

Are you working at all with Stability, Eleuther, or LAION? There have been some rumors that they are doing something similar to this and I'm wondering if this i

by Taek 4y ago

Are you working at all with Stability, Eleuther, or LAION? There have been some rumors that they are doing something similar to this and I'm wondering if this is a duplicated effort. Either way, huge fan, it would be awesome to have a LLaMA set of weights that are fully open.

igravious 4y ago
“Acknowledgements We are appreciative to the work done by the growing open-source AI community that made this project possible. That includes: Participants in building the RedPajama dataset including […] LAION. Meta AI — […]. EleutherAI — This project is built on the backs of the great team at EleutherAI — including the source code they provided for training GPT-NeoX. An award of computer time was provided by the INCITE program. This research also used resources of the Oak Ridge Leadership Computing Facility (OLCF), which is a DOE Office of Science User Facility supported under Contract DE-AC05-00OR22725.” The answer to your question is right there at the bottom of the page in the linked-to blog post :/