The "source data" is allegedly 8 trillion tokens. You can't just distribute that like its source code. The "binary" is the transformers python code, which in t

The "source data" is allegedly 8 trillion tokens. You can't just distribute that like its source code. The "binary" is the transformers python code, which in this case is essentially llamav2. Now, the documentation for this model is inexcusably poor. Hot dropping random code on a git repo without one drop of human language would be similarly "open source," but its bad practice, and unfortunately this is the standard in AI Research Land.